-- Logs begin at Wed 2022-05-25 06:38:34 UTC, end at Wed 2022-05-25 07:57:50 UTC. -- May 25 07:14:37.794514 dv-cinder-825492-15-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 25 07:14:37.803044 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 07:14:37 2022] *** May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: nodename: dv-cinder-825492-15-iscsi May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: machine: x86_64 May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: clock source: unix May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: pcre jit disabled May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: detected number of CPU cores: 4 May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: current working directory: / May 25 07:14:37.805043 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: detected binary path: /usr/bin/uwsgi-core May 25 07:14:37.805605 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: your processes number limit is 47680 May 25 07:14:37.805605 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: your memory page size is 4096 bytes May 25 07:14:37.805605 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: detected max file descriptor number: 2048 May 25 07:14:37.805605 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: lock engine: pthread robust mutexes May 25 07:14:37.805605 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: thunder lock: enabled May 25 07:14:37.805605 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 07:14:37.805605 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 07:14:37.850486 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: Python main interpreter initialized at 0x5627b5e879c0 May 25 07:14:37.850486 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: python threads support enabled May 25 07:14:37.850486 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: your server socket listen backlog is limited to 100 connections May 25 07:14:37.850486 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: your mercy for graceful operations on workers is 90 seconds May 25 07:14:37.850810 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: mapped 403077 bytes (393 KB) for 2 cores May 25 07:14:37.850895 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: *** Operational MODE: preforking *** May 25 07:14:37.851110 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: *** uWSGI is running in multiple interpreter mode *** May 25 07:14:37.851110 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: spawned uWSGI master process (pid: 80323) May 25 07:14:37.851302 dv-cinder-825492-15-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 25 07:14:37.857804 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: spawned uWSGI worker 1 (pid: 80334, cores: 1) May 25 07:14:37.857804 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: spawned uWSGI worker 2 (pid: 80335, cores: 1) May 25 07:14:37.857804 dv-cinder-825492-15-iscsi devstack@keystone.service[80323]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 07:14:43.527730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:14:43.527730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: from cryptography.utils import int_from_bytes May 25 07:14:43.528550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:14:43.528550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: from cryptography.utils import int_from_bytes May 25 07:14:43.578043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 07:14:43.578194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:14:43.578194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: from cryptography.utils import int_from_bytes May 25 07:14:43.578675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 07:14:43.578675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] command line args: [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 07:14:43.578813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:14:43.578813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: from cryptography.utils import int_from_bytes May 25 07:14:43.578942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 07:14:43.578942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ================================================================================ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 07:14:43.579069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] admin_token = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.579309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] config_dir = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.579496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.579677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] config_source = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.579855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] debug = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.580059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.581225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.581225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.581225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.581225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.581482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.581482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] log_config_append = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.581661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.581837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] log_dir = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.582037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] log_file = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.582250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.582493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.582744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.582991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.583175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.583352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.583592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.583842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.584075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.584305 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.584560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.584792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.585038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.585284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.585576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.586046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.586227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] publish_errors = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.586456 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.586686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.586862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.587110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.587879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.588161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] standard_threads = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.588395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.588828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.589027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.589186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] use_journal = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.589358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] use_json = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.589532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] use_stderr = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.589707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] use_syslog = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.589942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.590203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.590444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.590709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.590948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.591202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.591439 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.591942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.592180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.592429 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.592705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.592957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.593192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.593438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.593678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.593923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.594171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.594410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.594671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.594927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.595173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.595410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.595664 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.595928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.596179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.596429 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.596688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.596919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.597149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.597384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.597634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.597883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.598114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.598344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.598591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.598841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.599078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.599329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.599562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.599811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.600049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.600281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.600535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.600768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.600999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.601245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.601496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.601727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.601963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.602194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.602430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.602666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.603563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.603851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.604098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.604332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.604605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.604846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.605082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.605315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.605567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.605803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.606044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.606277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.606539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.606777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.607009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.607247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.607485 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.607754 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.607992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.608244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.608518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.608748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.608984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.609220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.609467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.609703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.609937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.610182 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.610421 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.610656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.610893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.611129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.611365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.611627 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.611868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.612108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.612344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.612610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.612850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.613086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.613322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.613554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.613784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.614015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.614250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.614479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.614735 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.614973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.615223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.615459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.615718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.615980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.616222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.616455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.external = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.616709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.617009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.617244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.617476 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.password = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.617707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] auth.token = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.617947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.618185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.618481 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.618733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.619016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.619229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.619466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.619700 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.619948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.620198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.620444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.620703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.620947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.621183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.621446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.621702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.621939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.622194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.622489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.622735 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.622997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.623239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.623497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.623733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.623970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.624217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.624464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.624725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.624973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.625208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.625463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.625698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.625952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.626187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.626433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.626669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.626917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.627165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.627400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.627635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.627713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 07:14:43.627878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 07:14:43.627958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.628074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] command line args: [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 07:14:43.628161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.628329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.628408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 07:14:43.628535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ================================================================================ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 07:14:43.628626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.628795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] admin_token = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.628886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.629045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] config_dir = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.629132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.629260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.629345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.629457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] config_source = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.629544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.629641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] debug = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.629721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.629860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.629965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.630099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.630204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.630290 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.630462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.630542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.630710 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.630797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.630983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.631060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.631163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] log_config_append = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.631241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.631389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.631466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.631538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] log_dir = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.631659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.631746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] log_file = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.631892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.631985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.632119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.632199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.632354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.632433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.632617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.632714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.632794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.632871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.632969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.633095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.633215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.633326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.633463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.633574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.633700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.633823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.633935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.634205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.634360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.634444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.634568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.634648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.634914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.634994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.635160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.635252 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.635393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.635472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.635631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.635868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.635955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.24/identity {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.636111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.636191 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] publish_errors = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.636347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.636435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.636605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.636685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.636789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.636869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.637045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.637135 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.637285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.637368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.637525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] standard_threads = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.637604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.637760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.637851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.638006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.638085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.638182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.638260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.638360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] use_journal = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.638454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.638529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] use_json = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.638681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.638768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] use_stderr = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.638864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] use_syslog = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.638943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.639099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:14:43.639180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.639362 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.639441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.639605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.639684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.639852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.639932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.640100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.640179 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.640346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.640432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.640605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.640686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.640834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.640914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.641069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.641178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.641339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.641418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.641593 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.641675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.641845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.642001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.642080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.642323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.642410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.642563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.642645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.642809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.642894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.643056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.643151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.643296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.643383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.643524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.643604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.643772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.643854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.644009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.644089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.644246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.644332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.644506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.644590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.644740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.644832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.644987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.645068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.645238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.645321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.645474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.645554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.645729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.645810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.645961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.646042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.646198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.646277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.646433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.646511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.646668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.646748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.646904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.646984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.647136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.647219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.647379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.647466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.647613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.647693 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.647851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.647931 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.648093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.648180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.648326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.648453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.648612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.648728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.648822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.648969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.649049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.649222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.649302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.649476 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.649563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.650247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.650335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.650538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.650709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.650848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.650970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.651099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.651215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.651343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.651454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] role.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.651579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.651707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] role.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.651821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.651941 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.652062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.652191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.652317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.652443 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.652596 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.652717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.652840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.652967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.653082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.653217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.653323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.653466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.653566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.653710 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.653797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.653953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.654034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.654185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.654272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.654435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.654523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.654690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.654770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.654939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.655018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.655186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.655267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.655428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.655604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.655684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.655846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.655926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.656101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.656188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.656354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.656434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.656629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.656709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.656879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.656960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.657115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.657195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.657353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.657432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.657593 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.657675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.657833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.657913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.658064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.658143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.658299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.658382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.658532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.658617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.658776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.658854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.659019 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.659099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.659259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.659339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.659492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.659571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.659730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.659810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.659958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.660036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.660194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] token.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.660278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.660431 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.660531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.660705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.660795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.660943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.661022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.661197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.661284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.661438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.661518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.661673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.661751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.661915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.661995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.662149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.662229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.662383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.662469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.662617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.662698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.662853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.662931 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.663085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.663163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.663329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.663409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.663569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.663654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.663798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.663875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.664041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.664123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.664312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.664398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.664585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.664669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.664831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.664925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.665068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.external = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.665148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.665347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.665936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.666124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.666363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.666451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.666678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.666759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.666922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.password = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.667002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.667151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] auth.token = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.667228 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.667392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.667473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.667634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.667714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.667877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.667963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.668113 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.668192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.668362 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.668441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.668624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.668706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.668869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.668949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.669100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.669180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.669341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.669422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.669578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.669658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.669731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80334) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 07:14:43.669831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.670072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.670320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.670559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.670826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.671092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.671332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.671590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.671878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.672127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.672394 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.672662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.672928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.673170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.673411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.673664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.673915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.674152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.674403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.674643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.674903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.675154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.675415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.675656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.675907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.676149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.676400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.676676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.676919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.677161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.677476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.677888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.678178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.678451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.678707 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.678944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.679181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.679417 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.679667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.679921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.680176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.680437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.680715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.681052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.681508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.681790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.682030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.682275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.682512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.682755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.683003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.683247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.683501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.683736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.683987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.684239 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.684506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.684755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.685007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.685243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.685485 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.685718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.685957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.686195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.686441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.686681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.686920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.687173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.687429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.687662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.687897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.688148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.688399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.688672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.688913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.689151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.689385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.689628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.689893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.690127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.690377 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.690626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.690890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.691134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.691368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.691606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.691843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.692081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.692314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.692592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.692844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.693094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.693344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.693593 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.693825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.694076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.694317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.694556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.694794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.695032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.695281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.695534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.695786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.696048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.696284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.696602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.697024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.697385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.697633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.697888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.698137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.698375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.698616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.698860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.699123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.699363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.699601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.699854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.700110 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.700249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.700342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.700500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.700609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.700738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.700850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.701097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.701336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] role.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.701587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] role.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.701820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.702071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.702432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.702695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.702957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.703208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.703462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.703715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.703968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.704205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.704457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.704735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.704990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.705245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.705656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.705899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.706155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.706409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.706664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.706917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.707157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.707415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.707671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.707913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.708150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.708386 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.708643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.708899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.709160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.709267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.709412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.709651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.709892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.710128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.710368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] token.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.710610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.710862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.711108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.711369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.711621 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.711860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.712108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.713139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.713403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.713643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.713888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.714129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.714382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.714636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.714870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.715116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.715418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.715683 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.715930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.716181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.716422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.716943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.717182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.717421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.717659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.717908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.718155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.718394 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.718641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.718879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.719131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.719369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.719615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.719848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.720089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.720327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:14:43.720515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80335) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 07:14:43.738573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.738799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.747900 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.748136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.748363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.756977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.778694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.778877 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.791988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.817327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.843559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.843786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.856002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.856241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.909975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.910294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.910432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.910516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.910652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.910752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.910869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.910952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.911085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.911168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.911306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.911524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.935179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.935414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.935645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.935748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.935868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.935978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.936084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.936203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.936284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.936425 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.936532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.936674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.936893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.937109 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.948065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.948711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.960385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.960652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.960877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.961100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.961319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.961533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.961748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80334) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.962477 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.962892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.963178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.963409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.963669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.963870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.964091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80335) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:14:43.981946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.982156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 07:14:43.982495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.982579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.982696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 07:14:43.982790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 07:14:43.982963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.983046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.983221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.983303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 07:14:43.983477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.983569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.983731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.983812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.983990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.984249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.995274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.995548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.995816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.995898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.996095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.996190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.996385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:43.996699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.004215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.004826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.007518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.007804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.008085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.008169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.008366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.008449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.008671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.008753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.008926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.009007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.009810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.009891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.010163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.010276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.010511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.010671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.010789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.010954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.011062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.011240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.011517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.011792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.037863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.038868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.039548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.039828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.041399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.041723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.045663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.045943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.046223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.047034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.047315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.047596 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.053546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.053829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.054948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.055230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.058442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.058841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.059126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.059409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.059683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.059954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.060119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.060224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.060505 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.060589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.060820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.061108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.061386 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.061663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.061937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.062210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.079670 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.079944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.081586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.081869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.084656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.086522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.088469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.088815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.090487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.090785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.094119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.096167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.097725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.099805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.101538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.101838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.102130 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.102415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.102698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.103491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.104368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.104699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.104996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.105285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.105575 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.105853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.122627 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.122911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.123178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.123439 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.125361 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.125645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.125915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.126180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.131479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.133220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.133496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.135152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.136924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.137120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.137204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.137396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.137721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.137998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.138272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.140451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.140754 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.141045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.141327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.141603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.152070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.152344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.152655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.152942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.153221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.153502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.153782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.155856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.156142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.156432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.156740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.157023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.157302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.157579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.172299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.175579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.176514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.178907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.179797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.180543 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.182354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.182648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.182929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.183590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.185235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.186877 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.187165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.187449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.190324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.191948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.194917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.195209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.195500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.195780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.196054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.197104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.200786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.201120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.201461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.201779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.205709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.205997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.206379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.210986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.211276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.211663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.215079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80334) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.215359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.215638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.215912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.216184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.216455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.217015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.217293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.217560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.217831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.218110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.218355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.218628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.218892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80334) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.220800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80335) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:14:44.221086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.221369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.221648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.221919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.222190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.222477 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.222745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.223021 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.223296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.223565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.223827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.224101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.224368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80335) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:14:44.257771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5627b5e879c0 pid: 80334 (default app) May 25 07:14:44.261852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1adf7e-a972-49f8-9d2f-fe215831a5eb None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:44.262145 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1adf7e-a972-49f8-9d2f-fe215831a5eb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:44.262425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1adf7e-a972-49f8-9d2f-fe215831a5eb None None] PATH_INFO: `/v3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:44.264720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5627b5e879c0 pid: 80335 (default app) May 25 07:14:44.266694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 791 bytes} [Wed May 25 07:14:44 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:14:53.138507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a4f98-8718-4766-88d4-9680c525be3d None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:53.139081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a4f98-8718-4766-88d4-9680c525be3d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:53.139081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a4f98-8718-4766-88d4-9680c525be3d None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:53.143491 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1/2] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:14:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:14:53.148550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:53.148971 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:53.149102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:53.217093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: INFO dbcounter [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] Registered counter for database keystone May 25 07:14:53.238613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG oslo_db.sqlalchemy.engines [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80334) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:14:53.245320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writer thread running {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:14:53.420856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG passlib.handlers.bcrypt [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80334) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 07:14:53.421201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG passlib.handlers.bcrypt [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80334) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 07:14:53.476233 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:14:53.478479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:14:53.600995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 2/3] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:14:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 25 07:14:53.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a4f98-8718-4766-88d4-9680c525be3d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:53.780991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: INFO dbcounter [None req-906a4f98-8718-4766-88d4-9680c525be3d None None] Registered counter for database keystone May 25 07:14:53.799862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG oslo_db.sqlalchemy.engines [None req-906a4f98-8718-4766-88d4-9680c525be3d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80335) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:14:53.805979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writer thread running {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:14:53.924080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a4f98-8718-4766-88d4-9680c525be3d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:53.928272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7658a6-4b24-4abc-81d4-97e2a94aceb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:53.928958 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7658a6-4b24-4abc-81d4-97e2a94aceb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:53.929244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7658a6-4b24-4abc-81d4-97e2a94aceb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:53.929520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7658a6-4b24-4abc-81d4-97e2a94aceb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:53.937652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7658a6-4b24-4abc-81d4-97e2a94aceb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:53.989504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7c7658a6-4b24-4abc-81d4-97e2a94aceb8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 07:14:53.989785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7658a6-4b24-4abc-81d4-97e2a94aceb8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:53.999295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 2/4] 10.222.0.24 () {58 vars in 1324 bytes} [Wed May 25 07:14:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:14:54.005323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:54.020348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda6979-6e7f-4fca-b916-26cf367a3444 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:54.025282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1bae99-32bb-4295-bef8-95916bdf893f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:54.026398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bae99-32bb-4295-bef8-95916bdf893f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:54.026680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bae99-32bb-4295-bef8-95916bdf893f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:54.026951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1bae99-32bb-4295-bef8-95916bdf893f admin admin] PATH_INFO: `/v3/projects/c4db8d1f990d4445ab6059278607233e` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:54.028445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bae99-32bb-4295-bef8-95916bdf893f admin admin] RBAC: Authorizing `identity:get_project(project_id=c4db8d1f990d4445ab6059278607233e)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:54.188828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a1bae99-32bb-4295-bef8-95916bdf893f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 07:14:54.189465 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1bae99-32bb-4295-bef8-95916bdf893f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:54.193850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 3/5] 10.222.0.24 () {56 vars in 1207 bytes} [Wed May 25 07:14:54 2022] GET /identity/v3/projects/c4db8d1f990d4445ab6059278607233e => generated 344 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:14:56.375338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e0797-f528-4cd3-89c9-ff537443cd3b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:56.375879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e0797-f528-4cd3-89c9-ff537443cd3b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:56.375879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e0797-f528-4cd3-89c9-ff537443cd3b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:56.380013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 3/6] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:14:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:14:56.386158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb6da1-98c1-401b-b869-7f15db4b3391 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:56.386588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb6da1-98c1-401b-b869-7f15db4b3391 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:56.386720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cb6da1-98c1-401b-b869-7f15db4b3391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:56.405617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-48cb6da1-98c1-401b-b869-7f15db4b3391 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:14:56.407199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-48cb6da1-98c1-401b-b869-7f15db4b3391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:14:56.415157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 4/7] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:14:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 25 07:14:56.437833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e0797-f528-4cd3-89c9-ff537443cd3b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:56.452069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e0797-f528-4cd3-89c9-ff537443cd3b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:56.456316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71248bf-8dcb-4f62-90ea-0e688f5c83d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:56.456994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71248bf-8dcb-4f62-90ea-0e688f5c83d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:56.457284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71248bf-8dcb-4f62-90ea-0e688f5c83d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:56.457562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71248bf-8dcb-4f62-90ea-0e688f5c83d3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:56.465359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71248bf-8dcb-4f62-90ea-0e688f5c83d3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:56.467424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71248bf-8dcb-4f62-90ea-0e688f5c83d3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:56.476154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 4/8] 10.222.0.24 () {58 vars in 1324 bytes} [Wed May 25 07:14:56 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:14:56.481624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb6da1-98c1-401b-b869-7f15db4b3391 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:56.490531 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cb6da1-98c1-401b-b869-7f15db4b3391 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:56.495498 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35d97d3-a3da-4e37-9dc8-f685046ad9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:56.496361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d97d3-a3da-4e37-9dc8-f685046ad9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:56.496674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d97d3-a3da-4e37-9dc8-f685046ad9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:56.496954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35d97d3-a3da-4e37-9dc8-f685046ad9aa admin admin] PATH_INFO: `/v3/users/91002622404a49918bac736d37052f04` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:56.498376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d97d3-a3da-4e37-9dc8-f685046ad9aa admin admin] RBAC: Authorizing `identity:get_user(user_id=91002622404a49918bac736d37052f04)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:56.500213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35d97d3-a3da-4e37-9dc8-f685046ad9aa admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:56.501793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 5/9] 10.222.0.24 () {56 vars in 1198 bytes} [Wed May 25 07:14:56 2022] GET /identity/v3/users/91002622404a49918bac736d37052f04 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:14:58.763886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a36697-6bb3-4d15-9f0b-0c378082d067 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:58.764392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a36697-6bb3-4d15-9f0b-0c378082d067 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:58.764506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a36697-6bb3-4d15-9f0b-0c378082d067 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:58.764637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e897a-56b1-4e7e-a169-e7bb240bf247 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:58.765092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e897a-56b1-4e7e-a169-e7bb240bf247 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:58.765188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e897a-56b1-4e7e-a169-e7bb240bf247 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:58.765836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 5/10] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:14:58.766504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 6/11] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:14:58.770752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473597-731c-4fcc-88b7-8950e99b1868 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:58.771035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473597-731c-4fcc-88b7-8950e99b1868 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:58.771312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e473597-731c-4fcc-88b7-8950e99b1868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:58.771604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb11d57-a08d-4e1c-95c3-bf70a96c6679 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:58.771885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb11d57-a08d-4e1c-95c3-bf70a96c6679 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:58.772158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb11d57-a08d-4e1c-95c3-bf70a96c6679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:58.789556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-afb11d57-a08d-4e1c-95c3-bf70a96c6679 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:14:58.791375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-afb11d57-a08d-4e1c-95c3-bf70a96c6679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:14:58.811754 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG passlib.handlers.bcrypt [None req-0e473597-731c-4fcc-88b7-8950e99b1868 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80335) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 07:14:58.812181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG passlib.handlers.bcrypt [None req-0e473597-731c-4fcc-88b7-8950e99b1868 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80335) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 07:14:58.859488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0e473597-731c-4fcc-88b7-8950e99b1868 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:14:58.861049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0e473597-731c-4fcc-88b7-8950e99b1868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:14:58.868741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 7/12] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:14:58.891352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb11d57-a08d-4e1c-95c3-bf70a96c6679 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:58.916254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:14:58.962804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 6/13] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:14:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:14:58.984841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e473597-731c-4fcc-88b7-8950e99b1868 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:58.995737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb11d57-a08d-4e1c-95c3-bf70a96c6679 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:59.031095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072580cf-23dd-4dfe-be8a-307144cdb751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:59.031890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072580cf-23dd-4dfe-be8a-307144cdb751 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:59.032173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072580cf-23dd-4dfe-be8a-307144cdb751 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:59.032449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072580cf-23dd-4dfe-be8a-307144cdb751 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:59.043285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072580cf-23dd-4dfe-be8a-307144cdb751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-072580cf-23dd-4dfe-be8a-307144cdb751 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:14:59.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:14:59.055396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:14:59.056252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 8/14] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:14:59.061686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072580cf-23dd-4dfe-be8a-307144cdb751 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:59.085437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e473597-731c-4fcc-88b7-8950e99b1868 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:59.089185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:14:59.123998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdccdd7-a174-4b3b-9079-70a1506301e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:59.124866 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdccdd7-a174-4b3b-9079-70a1506301e6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:59.125152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdccdd7-a174-4b3b-9079-70a1506301e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:59.125427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdccdd7-a174-4b3b-9079-70a1506301e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:59.143510 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:14:59.161706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072580cf-23dd-4dfe-be8a-307144cdb751 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:59.194200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdccdd7-a174-4b3b-9079-70a1506301e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:59.195701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b3d8a-167b-4495-9f7e-28f2834903c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:59.195840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdccdd7-a174-4b3b-9079-70a1506301e6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:59.196928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b3d8a-167b-4495-9f7e-28f2834903c9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:59.197219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b3d8a-167b-4495-9f7e-28f2834903c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:59.197498 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b3d8a-167b-4495-9f7e-28f2834903c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:59.198252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b3d8a-167b-4495-9f7e-28f2834903c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:14:59.198564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b3d8a-167b-4495-9f7e-28f2834903c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:59.199949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64b3d8a-167b-4495-9f7e-28f2834903c9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:59.211545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 9/15] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:14:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:14:59.218060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b3d8a-167b-4495-9f7e-28f2834903c9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:59.293702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 7/16] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:14:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:14:59.299217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdccdd7-a174-4b3b-9079-70a1506301e6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:59.301893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:14:59.320381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b3d8a-167b-4495-9f7e-28f2834903c9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:59.356447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17a7f-c253-4046-a245-acd1baa313fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:59.357347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17a7f-c253-4046-a245-acd1baa313fe None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:59.357626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17a7f-c253-4046-a245-acd1baa313fe None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:59.357900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da17a7f-c253-4046-a245-acd1baa313fe None admin] PATH_INFO: `/v3/users/91002622404a49918bac736d37052f04` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:59.359096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da17a7f-c253-4046-a245-acd1baa313fe None admin] RBAC: Authorizing `identity:get_user(user_id=91002622404a49918bac736d37052f04)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:59.360572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da17a7f-c253-4046-a245-acd1baa313fe None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:59.362290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 10/17] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:14:59 2022] GET /identity/v3/users/91002622404a49918bac736d37052f04 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:14:59.367573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17a7f-c253-4046-a245-acd1baa313fe None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:59.382487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:14:59.399134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdccdd7-a174-4b3b-9079-70a1506301e6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:59.434270 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126606db-8454-41c2-9737-383cbcefc449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:59.435536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126606db-8454-41c2-9737-383cbcefc449 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:59.435826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126606db-8454-41c2-9737-383cbcefc449 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:59.436107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126606db-8454-41c2-9737-383cbcefc449 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:59.455178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126606db-8454-41c2-9737-383cbcefc449 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:59.456826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126606db-8454-41c2-9737-383cbcefc449 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:59.468535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da17a7f-c253-4046-a245-acd1baa313fe None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-126606db-8454-41c2-9737-383cbcefc449 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:14:59.477984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:14:59.478996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:14:59.480070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:14:59.480070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:14:59.480070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:14:59.480070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:14:59.480070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 8/18] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:14:59.485002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126606db-8454-41c2-9737-383cbcefc449 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:59.503214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113217ba-f1d2-4d13-94cd-3a3b5f47bf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:59.504007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113217ba-f1d2-4d13-94cd-3a3b5f47bf84 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:59.504288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113217ba-f1d2-4d13-94cd-3a3b5f47bf84 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:59.504580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113217ba-f1d2-4d13-94cd-3a3b5f47bf84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:59.505760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113217ba-f1d2-4d13-94cd-3a3b5f47bf84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:59.507211 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113217ba-f1d2-4d13-94cd-3a3b5f47bf84 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:59.509678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 11/19] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:14:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:14:59.515259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113217ba-f1d2-4d13-94cd-3a3b5f47bf84 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:14:59.540858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:14:59.586083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126606db-8454-41c2-9737-383cbcefc449 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:59.596242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:14:59.614622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113217ba-f1d2-4d13-94cd-3a3b5f47bf84 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:14:59.621238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036d150-eace-4193-8f4a-e99be5a11c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:59.621903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d150-eace-4193-8f4a-e99be5a11c96 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:59.622188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d150-eace-4193-8f4a-e99be5a11c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:59.622465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036d150-eace-4193-8f4a-e99be5a11c96 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:59.623196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d150-eace-4193-8f4a-e99be5a11c96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:14:59.623502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d150-eace-4193-8f4a-e99be5a11c96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:59.624927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c036d150-eace-4193-8f4a-e99be5a11c96 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:59.650837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e118d8-17fe-4324-88c2-6ba8cc766cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:14:59.651437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e118d8-17fe-4324-88c2-6ba8cc766cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:14:59.651723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e118d8-17fe-4324-88c2-6ba8cc766cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:14:59.652002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e118d8-17fe-4324-88c2-6ba8cc766cd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:14:59.652897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e118d8-17fe-4324-88c2-6ba8cc766cd2 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.domain.id=default, user.id=91002622404a49918bac736d37052f04) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:14:59.653215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e118d8-17fe-4324-88c2-6ba8cc766cd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:14:59.654732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e118d8-17fe-4324-88c2-6ba8cc766cd2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:14:59.662405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 12/20] 10.222.0.24 () {56 vars in 1322 bytes} [Wed May 25 07:14:59 2022] GET /identity/v3/role_assignments?user.id=91002622404a49918bac736d37052f04&scope.domain.id=default&role.id=7c09d078126441909df0a46212ffea63 => generated 233 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:14:59.754602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 9/21] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:02.192019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d328a-5fa8-4c03-a8ab-13994912989a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:02.192545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d328a-5fa8-4c03-a8ab-13994912989a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:02.192621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0d328a-5fa8-4c03-a8ab-13994912989a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:02.193982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 13/22] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:02.200112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b1790-b8b8-44bf-82a3-f7c058243287 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:02.200576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b1790-b8b8-44bf-82a3-f7c058243287 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:02.200769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941b1790-b8b8-44bf-82a3-f7c058243287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:02.229301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-941b1790-b8b8-44bf-82a3-f7c058243287 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:02.230520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-941b1790-b8b8-44bf-82a3-f7c058243287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:02.322522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 10/23] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:02.356689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d328a-5fa8-4c03-a8ab-13994912989a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:02.501818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0d328a-5fa8-4c03-a8ab-13994912989a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:02.543841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fa650-d227-43fb-9c14-5206ddcbf99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:02.545097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fa650-d227-43fb-9c14-5206ddcbf99a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:02.545599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fa650-d227-43fb-9c14-5206ddcbf99a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:02.546068 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fa650-d227-43fb-9c14-5206ddcbf99a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:02.567894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fa650-d227-43fb-9c14-5206ddcbf99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-d67fa650-d227-43fb-9c14-5206ddcbf99a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:02.576748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:02.577686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:02.578458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:02.584597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 14/24] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:15:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:02.598076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b1790-b8b8-44bf-82a3-f7c058243287 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:02.677231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5301f-68ab-40c6-9a85-e9be71cb7fca None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:02.677870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5301f-68ab-40c6-9a85-e9be71cb7fca None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:02.678350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c5301f-68ab-40c6-9a85-e9be71cb7fca None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:02.679924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 15/25] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:02.684778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:02.686285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2c2ad-f036-4b3b-bbc1-4221b45382d5 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:02.686812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2c2ad-f036-4b3b-bbc1-4221b45382d5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:02.687292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2c2ad-f036-4b3b-bbc1-4221b45382d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:02.693685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:02.705765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9af2c2ad-f036-4b3b-bbc1-4221b45382d5 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:02.707294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9af2c2ad-f036-4b3b-bbc1-4221b45382d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:02.771731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941b1790-b8b8-44bf-82a3-f7c058243287 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:02.806399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 16/26] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:02.832748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2c2ad-f036-4b3b-bbc1-4221b45382d5 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:02.839475 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79180cfa-bc93-4fdd-8446-16089bbdded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:02.840584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79180cfa-bc93-4fdd-8446-16089bbdded8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:02.841105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79180cfa-bc93-4fdd-8446-16089bbdded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:02.841907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79180cfa-bc93-4fdd-8446-16089bbdded8 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:02.842913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79180cfa-bc93-4fdd-8446-16089bbdded8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:02.843437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79180cfa-bc93-4fdd-8446-16089bbdded8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:02.845124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79180cfa-bc93-4fdd-8446-16089bbdded8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:02.860015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 11/27] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:02.865101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79180cfa-bc93-4fdd-8446-16089bbdded8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:03.027348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af2c2ad-f036-4b3b-bbc1-4221b45382d5 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:03.047934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79180cfa-bc93-4fdd-8446-16089bbdded8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:03.063679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:03.071414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d1200-3cf9-42d3-b74d-7e6314df73a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:03.072681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d1200-3cf9-42d3-b74d-7e6314df73a9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.073450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d1200-3cf9-42d3-b74d-7e6314df73a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.073928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d1200-3cf9-42d3-b74d-7e6314df73a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.076828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:03.088813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d1200-3cf9-42d3-b74d-7e6314df73a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:03.090516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035d1200-3cf9-42d3-b74d-7e6314df73a9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:03.092775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0b9713-7288-4c0a-8f6e-c9cfffd82701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:03.094032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b9713-7288-4c0a-8f6e-c9cfffd82701 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.094448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b9713-7288-4c0a-8f6e-c9cfffd82701 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.094801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0b9713-7288-4c0a-8f6e-c9cfffd82701 None admin] PATH_INFO: `/v3/users/91002622404a49918bac736d37052f04` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.096440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b9713-7288-4c0a-8f6e-c9cfffd82701 None admin] RBAC: Authorizing `identity:get_user(user_id=91002622404a49918bac736d37052f04)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:03.098050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0b9713-7288-4c0a-8f6e-c9cfffd82701 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:03.100733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 12/28] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:02 2022] GET /identity/v3/users/91002622404a49918bac736d37052f04 => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:03.102446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82720e-80f6-48f6-a95e-35848207b95f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.102821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82720e-80f6-48f6-a95e-35848207b95f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.103172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82720e-80f6-48f6-a95e-35848207b95f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.104541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 13/29] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:03.105669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e10c-ba49-41a6-8118-47ca568ee3b2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.106095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e10c-ba49-41a6-8118-47ca568ee3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.106579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6e10c-ba49-41a6-8118-47ca568ee3b2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.112194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 14/30] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:03.113577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972543-5ff2-43c5-94e5-eb9e4a3c45ed None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.114029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972543-5ff2-43c5-94e5-eb9e4a3c45ed None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.114467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a972543-5ff2-43c5-94e5-eb9e4a3c45ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-035d1200-3cf9-42d3-b74d-7e6314df73a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:15:03.114694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:03.124629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:03.125442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:15:03.125442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:15:03.125442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:15:03.125442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:03.125442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 17/31] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:03.125442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d1200-3cf9-42d3-b74d-7e6314df73a9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:03.136828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5a972543-5ff2-43c5-94e5-eb9e4a3c45ed None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:03.138483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5a972543-5ff2-43c5-94e5-eb9e4a3c45ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:03.229206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 15/32] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:03.232070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0774c-8633-4afd-8eaf-ecb701e025c0 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.232531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0774c-8633-4afd-8eaf-ecb701e025c0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.233188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b0774c-8633-4afd-8eaf-ecb701e025c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.252334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d1200-3cf9-42d3-b74d-7e6314df73a9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:03.257308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-43b0774c-8633-4afd-8eaf-ecb701e025c0 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:03.259026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-43b0774c-8633-4afd-8eaf-ecb701e025c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:03.300802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac9294-edfc-4ed0-ae56-a1d5d4e019fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:03.301826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac9294-edfc-4ed0-ae56-a1d5d4e019fa None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.302485 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac9294-edfc-4ed0-ae56-a1d5d4e019fa None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.302936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac9294-edfc-4ed0-ae56-a1d5d4e019fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.304614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac9294-edfc-4ed0-ae56-a1d5d4e019fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:03.307372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac9294-edfc-4ed0-ae56-a1d5d4e019fa None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:03.309871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 18/33] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:03.310882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac9294-edfc-4ed0-ae56-a1d5d4e019fa None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:03.353868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 16/34] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:03.354976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0774c-8633-4afd-8eaf-ecb701e025c0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:03.372927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:03.403148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:03.430082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac9294-edfc-4ed0-ae56-a1d5d4e019fa None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:03.478259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8dd2e3-9c1f-47df-834f-554c82e30bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:03.479255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dd2e3-9c1f-47df-834f-554c82e30bc1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.479531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b0774c-8633-4afd-8eaf-ecb701e025c0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:03.479860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dd2e3-9c1f-47df-834f-554c82e30bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.480275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8dd2e3-9c1f-47df-834f-554c82e30bc1 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.481222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8dd2e3-9c1f-47df-834f-554c82e30bc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:03.481778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8dd2e3-9c1f-47df-834f-554c82e30bc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:03.483558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8dd2e3-9c1f-47df-834f-554c82e30bc1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:03.503262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 19/35] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:03.504584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8dd2e3-9c1f-47df-834f-554c82e30bc1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:03.517517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf376e-40dd-4f48-b348-d3427e3742e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:03.518402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf376e-40dd-4f48-b348-d3427e3742e5 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.518759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf376e-40dd-4f48-b348-d3427e3742e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.519109 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf376e-40dd-4f48-b348-d3427e3742e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.519951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf376e-40dd-4f48-b348-d3427e3742e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:03.521460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baf376e-40dd-4f48-b348-d3427e3742e5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:03.615015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8dd2e3-9c1f-47df-834f-554c82e30bc1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:03.631118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:03.654086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7ae67-d567-4055-b751-fccaea16f3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:03.654996 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7ae67-d567-4055-b751-fccaea16f3f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.655380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7ae67-d567-4055-b751-fccaea16f3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.655670 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e7ae67-d567-4055-b751-fccaea16f3f8 None admin] PATH_INFO: `/v3/domains/default/users/91002622404a49918bac736d37052f04/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.658301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7ae67-d567-4055-b751-fccaea16f3f8 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=91002622404a49918bac736d37052f04, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:03.659821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e7ae67-d567-4055-b751-fccaea16f3f8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:03.749845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 17/36] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 07:15:03 2022] POST /identity/v3/roles => generated 225 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:03.751311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf376e-40dd-4f48-b348-d3427e3742e5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:03.851369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 20/37] 10.222.0.24 () {58 vars in 1361 bytes} [Wed May 25 07:15:03 2022] PUT /identity/v3/domains/default/users/91002622404a49918bac736d37052f04/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:03.852551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7ae67-d567-4055-b751-fccaea16f3f8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:03.859095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:03.866317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf376e-40dd-4f48-b348-d3427e3742e5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:03.915107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d90d5bc-e88e-481d-ab8b-f42a93155d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:03.915933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90d5bc-e88e-481d-ab8b-f42a93155d90 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.916322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90d5bc-e88e-481d-ab8b-f42a93155d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.916749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d90d5bc-e88e-481d-ab8b-f42a93155d90 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.917680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90d5bc-e88e-481d-ab8b-f42a93155d90 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:03.919424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d90d5bc-e88e-481d-ab8b-f42a93155d90 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:03.979194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 18/38] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 07:15:03 2022] POST /identity/v3/roles => generated 219 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:03.981007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23252e-ea0f-4741-adf5-c7167f3faacc None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.981404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23252e-ea0f-4741-adf5-c7167f3faacc None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.982053 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c23252e-ea0f-4741-adf5-c7167f3faacc None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:03.983275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 19/39] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:03.989525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c50f90-6151-4421-b71d-8028d0316452 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:03.989713 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e7ae67-d567-4055-b751-fccaea16f3f8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:03.989937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c50f90-6151-4421-b71d-8028d0316452 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:03.990317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c50f90-6151-4421-b71d-8028d0316452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:04.024467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-63c50f90-6151-4421-b71d-8028d0316452 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:04.026302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-63c50f90-6151-4421-b71d-8028d0316452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:04.038857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db7dfc-4716-43bd-84ed-e79e96eff0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:04.039956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db7dfc-4716-43bd-84ed-e79e96eff0ec None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:04.040466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db7dfc-4716-43bd-84ed-e79e96eff0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:04.040981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db7dfc-4716-43bd-84ed-e79e96eff0ec None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:04.041940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db7dfc-4716-43bd-84ed-e79e96eff0ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:04.044179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db7dfc-4716-43bd-84ed-e79e96eff0ec None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:04.108886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 20/40] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:04.110358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0a3b8-f30c-4852-bd20-0dc6cce40f12 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:04.110658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0a3b8-f30c-4852-bd20-0dc6cce40f12 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:04.110938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb0a3b8-f30c-4852-bd20-0dc6cce40f12 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:04.112261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 21/41] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:04.121135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6ef3-7a5e-4795-a059-640f83a41e02 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:04.121466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6ef3-7a5e-4795-a059-640f83a41e02 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:04.121803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa6ef3-7a5e-4795-a059-640f83a41e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:04.141765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-18fa6ef3-7a5e-4795-a059-640f83a41e02 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:04.143228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-18fa6ef3-7a5e-4795-a059-640f83a41e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:04.160342 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 21/42] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:15:03 2022] POST /identity/v3/projects => generated 301 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:04.161378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db7dfc-4716-43bd-84ed-e79e96eff0ec None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:04.212716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:04.262106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 22/43] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:04.289523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6ef3-7a5e-4795-a059-640f83a41e02 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:04.317418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:04.325977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db7dfc-4716-43bd-84ed-e79e96eff0ec None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:04.377358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d3c46-31b4-4433-8ff2-5d8ad0e2bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:04.378085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d3c46-31b4-4433-8ff2-5d8ad0e2bc2a None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:04.378437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d3c46-31b4-4433-8ff2-5d8ad0e2bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:04.378863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d3c46-31b4-4433-8ff2-5d8ad0e2bc2a None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:04.379703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d3c46-31b4-4433-8ff2-5d8ad0e2bc2a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:04.381498 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d3c46-31b4-4433-8ff2-5d8ad0e2bc2a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:04.428226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa6ef3-7a5e-4795-a059-640f83a41e02 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:04.456944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 22/44] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 07:15:04 2022] POST /identity/v3/roles => generated 223 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:04.481311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8542287a-f028-4422-a8c7-8363ed52e2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:04.481507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542287a-f028-4422-a8c7-8363ed52e2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:04.481771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542287a-f028-4422-a8c7-8363ed52e2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:04.481933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8542287a-f028-4422-a8c7-8363ed52e2e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:04.483272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542287a-f028-4422-a8c7-8363ed52e2e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:04.484828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8542287a-f028-4422-a8c7-8363ed52e2e9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:04.486791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 23/45] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:04.492521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d3c46-31b4-4433-8ff2-5d8ad0e2bc2a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:04.596611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:04.609811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d3c46-31b4-4433-8ff2-5d8ad0e2bc2a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:04.649407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a32fe-7f06-4688-a516-f92347a19a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:04.650006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a32fe-7f06-4688-a516-f92347a19a10 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:04.651261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a32fe-7f06-4688-a516-f92347a19a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:04.651261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a32fe-7f06-4688-a516-f92347a19a10 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:04.651487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a32fe-7f06-4688-a516-f92347a19a10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:04.652808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560a32fe-7f06-4688-a516-f92347a19a10 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:04.731669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 23/46] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:15:04 2022] POST /identity/v3/projects => generated 312 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:06.396739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001d43-a2e1-4348-8c46-7213b729c045 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:06.397249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001d43-a2e1-4348-8c46-7213b729c045 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:06.397333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8001d43-a2e1-4348-8c46-7213b729c045 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:06.398667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 24/47] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:06.404491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47998911-258b-4a93-8596-62488fdc43a6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:06.404893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47998911-258b-4a93-8596-62488fdc43a6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:06.405066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47998911-258b-4a93-8596-62488fdc43a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:06.422435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-47998911-258b-4a93-8596-62488fdc43a6 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:06.423960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-47998911-258b-4a93-8596-62488fdc43a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:06.489753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 24/48] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:06.513036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8001d43-a2e1-4348-8c46-7213b729c045 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:06.599245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:06.615320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8001d43-a2e1-4348-8c46-7213b729c045 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:06.649449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea96a17-f280-40c3-9c6c-e6de1035baa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:06.650168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea96a17-f280-40c3-9c6c-e6de1035baa2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:06.650451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea96a17-f280-40c3-9c6c-e6de1035baa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:06.650724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea96a17-f280-40c3-9c6c-e6de1035baa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:06.661516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea96a17-f280-40c3-9c6c-e6de1035baa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-6ea96a17-f280-40c3-9c6c-e6de1035baa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:06.670765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:06.671673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:06.672667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 25/49] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:06.677768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47998911-258b-4a93-8596-62488fdc43a6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:06.746148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:06.780201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47998911-258b-4a93-8596-62488fdc43a6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:06.813245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ac2acb-0683-4c4d-97da-399c2fefa4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:06.813915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac2acb-0683-4c4d-97da-399c2fefa4b6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:06.814202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac2acb-0683-4c4d-97da-399c2fefa4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:06.814479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ac2acb-0683-4c4d-97da-399c2fefa4b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:06.815230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac2acb-0683-4c4d-97da-399c2fefa4b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:06.815538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac2acb-0683-4c4d-97da-399c2fefa4b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:06.816987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ac2acb-0683-4c4d-97da-399c2fefa4b6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:06.825847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 25/50] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:06.831551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea96a17-f280-40c3-9c6c-e6de1035baa2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:06.912105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1744-0e34-46a2-9578-dde4ad226a7e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:06.912366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1744-0e34-46a2-9578-dde4ad226a7e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:06.912622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6f1744-0e34-46a2-9578-dde4ad226a7e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:06.913993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 26/51] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:06.919075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134537e-ae29-4711-b147-75a843452eea None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:06.919361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134537e-ae29-4711-b147-75a843452eea None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:06.919640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3134537e-ae29-4711-b147-75a843452eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:06.929873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea96a17-f280-40c3-9c6c-e6de1035baa2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:06.936427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3134537e-ae29-4711-b147-75a843452eea None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:06.937657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3134537e-ae29-4711-b147-75a843452eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:06.964297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d83c1-a0b9-4a12-9f33-0876ec3793bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:06.965208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d83c1-a0b9-4a12-9f33-0876ec3793bc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:06.965491 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d83c1-a0b9-4a12-9f33-0876ec3793bc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:06.965762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d83c1-a0b9-4a12-9f33-0876ec3793bc None admin] PATH_INFO: `/v3/users/91002622404a49918bac736d37052f04` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:06.967226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d83c1-a0b9-4a12-9f33-0876ec3793bc None admin] RBAC: Authorizing `identity:get_user(user_id=91002622404a49918bac736d37052f04)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:06.968717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d83c1-a0b9-4a12-9f33-0876ec3793bc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:06.970357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 26/52] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:06 2022] GET /identity/v3/users/91002622404a49918bac736d37052f04 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:06.975750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d83c1-a0b9-4a12-9f33-0876ec3793bc None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:06.990404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:07.003849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 27/53] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:07.027520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134537e-ae29-4711-b147-75a843452eea None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:07.075318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d83c1-a0b9-4a12-9f33-0876ec3793bc None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:07.085042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:07.109892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06adc6-5fde-4a7c-8d2b-9c65113be375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:07.110692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06adc6-5fde-4a7c-8d2b-9c65113be375 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:07.110978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06adc6-5fde-4a7c-8d2b-9c65113be375 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:07.111284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06adc6-5fde-4a7c-8d2b-9c65113be375 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:07.112502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06adc6-5fde-4a7c-8d2b-9c65113be375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:07.113980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06adc6-5fde-4a7c-8d2b-9c65113be375 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:07.115607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 27/54] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:07.121943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06adc6-5fde-4a7c-8d2b-9c65113be375 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:07.125533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3134537e-ae29-4711-b147-75a843452eea None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:07.159660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034a28b-4239-4e36-ac25-2ecfd7cdc2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:07.160458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034a28b-4239-4e36-ac25-2ecfd7cdc2f0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:07.160778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034a28b-4239-4e36-ac25-2ecfd7cdc2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:07.161055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a034a28b-4239-4e36-ac25-2ecfd7cdc2f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:07.162292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034a28b-4239-4e36-ac25-2ecfd7cdc2f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:07.163783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a034a28b-4239-4e36-ac25-2ecfd7cdc2f0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:07.165588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 28/55] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:07.170978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034a28b-4239-4e36-ac25-2ecfd7cdc2f0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:07.201376 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:07.220323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06adc6-5fde-4a7c-8d2b-9c65113be375 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:07.255158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94f30f-04e6-4149-bdec-4bd1ee9702ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:07.256048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94f30f-04e6-4149-bdec-4bd1ee9702ca None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:07.256331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94f30f-04e6-4149-bdec-4bd1ee9702ca None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:07.256638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94f30f-04e6-4149-bdec-4bd1ee9702ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:07.257477 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94f30f-04e6-4149-bdec-4bd1ee9702ca None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.domain.id=default, user.id=91002622404a49918bac736d37052f04) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:07.257782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94f30f-04e6-4149-bdec-4bd1ee9702ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:07.259799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94f30f-04e6-4149-bdec-4bd1ee9702ca None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:07.268378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 28/56] 10.222.0.24 () {56 vars in 1322 bytes} [Wed May 25 07:15:07 2022] GET /identity/v3/role_assignments?user.id=91002622404a49918bac736d37052f04&scope.domain.id=default&role.id=7c09d078126441909df0a46212ffea63 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:07.272081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a034a28b-4239-4e36-ac25-2ecfd7cdc2f0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:07.301590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:07.309763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be9360-1a32-4141-b986-9a6c437b1216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:07.310449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9360-1a32-4141-b986-9a6c437b1216 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:07.310736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9360-1a32-4141-b986-9a6c437b1216 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:07.311018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be9360-1a32-4141-b986-9a6c437b1216 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:07.311759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be9360-1a32-4141-b986-9a6c437b1216 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:07.313297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be9360-1a32-4141-b986-9a6c437b1216 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:07.589180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 29/57] 10.222.0.24 () {60 vars in 1140 bytes} [Wed May 25 07:15:07 2022] POST /identity/v3/projects => generated 298 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:15:09.782921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd24ea-c046-41e1-a047-a6b3efef0b34 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:09.783426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd24ea-c046-41e1-a047-a6b3efef0b34 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:09.783537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bd24ea-c046-41e1-a047-a6b3efef0b34 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:09.784878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 29/58] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:09.790287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d43e20-dad8-4f60-8241-a10d7600cbb7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:09.790694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d43e20-dad8-4f60-8241-a10d7600cbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:09.790853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d43e20-dad8-4f60-8241-a10d7600cbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:09.807171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a4d43e20-dad8-4f60-8241-a10d7600cbb7 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:09.808356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a4d43e20-dad8-4f60-8241-a10d7600cbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:09.872728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 30/59] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:09.896767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd24ea-c046-41e1-a047-a6b3efef0b34 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:09.997559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bd24ea-c046-41e1-a047-a6b3efef0b34 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:10.030265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f3c521-d2af-480b-b604-42a9cb5e10c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:10.031061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3c521-d2af-480b-b604-42a9cb5e10c0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:10.031351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3c521-d2af-480b-b604-42a9cb5e10c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:10.031629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f3c521-d2af-480b-b604-42a9cb5e10c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:10.032845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3c521-d2af-480b-b604-42a9cb5e10c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:10.034317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f3c521-d2af-480b-b604-42a9cb5e10c0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:10.035931 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 30/60] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:10.042231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d43e20-dad8-4f60-8241-a10d7600cbb7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:10.137406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d43e20-dad8-4f60-8241-a10d7600cbb7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:10.147430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:10.170246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8499d-8246-40e9-9b90-1fc975ee0a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:10.170913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8499d-8246-40e9-9b90-1fc975ee0a85 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:10.171199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8499d-8246-40e9-9b90-1fc975ee0a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:10.171479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8499d-8246-40e9-9b90-1fc975ee0a85 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:10.172183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8499d-8246-40e9-9b90-1fc975ee0a85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:10.173674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8499d-8246-40e9-9b90-1fc975ee0a85 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:10.307384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 31/61] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:15:10 2022] POST /identity/v3/users => generated 275 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:13.511471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba5a06-54fe-4b08-b26f-ba6278bf4ea4 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:13.511471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba5a06-54fe-4b08-b26f-ba6278bf4ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:13.511471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba5a06-54fe-4b08-b26f-ba6278bf4ea4 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:13.511471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 31/62] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:13.516995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f311e-bb6b-4df0-be18-d8c8bd499d6f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:13.517814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f311e-bb6b-4df0-be18-d8c8bd499d6f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:13.518312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f311e-bb6b-4df0-be18-d8c8bd499d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:13.536237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-872f311e-bb6b-4df0-be18-d8c8bd499d6f None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:13.541887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-872f311e-bb6b-4df0-be18-d8c8bd499d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:13.635229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 32/63] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:13.666047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba5a06-54fe-4b08-b26f-ba6278bf4ea4 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:13.686835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:13.785168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e529dad-8263-481f-b64f-f0e895f4c3f6 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:13.785386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e529dad-8263-481f-b64f-f0e895f4c3f6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:13.785827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e529dad-8263-481f-b64f-f0e895f4c3f6 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:13.787371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 33/64] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:13.793783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e88f-b5ab-4f6d-bb61-6984aa5716c3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:13.794333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e88f-b5ab-4f6d-bb61-6984aa5716c3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:13.794820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef1e88f-b5ab-4f6d-bb61-6984aa5716c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:13.799989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba5a06-54fe-4b08-b26f-ba6278bf4ea4 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:13.825605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6ef1e88f-b5ab-4f6d-bb61-6984aa5716c3 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:13.827004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6ef1e88f-b5ab-4f6d-bb61-6984aa5716c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:13.843064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3989b46-3c1f-462e-bbf8-9ffeb8d4dc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:13.845752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3989b46-3c1f-462e-bbf8-9ffeb8d4dc5f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:13.846187 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3989b46-3c1f-462e-bbf8-9ffeb8d4dc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:13.846803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3989b46-3c1f-462e-bbf8-9ffeb8d4dc5f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:13.872051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3989b46-3c1f-462e-bbf8-9ffeb8d4dc5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a3989b46-3c1f-462e-bbf8-9ffeb8d4dc5f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:13.884218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:13.885380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:13.886372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:13.893197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 32/65] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:13.900211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3989b46-3c1f-462e-bbf8-9ffeb8d4dc5f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:13.937769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 34/66] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:13.939528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ccdd4-2cdf-4523-9e5b-92028f9ca5c3 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:13.940069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ccdd4-2cdf-4523-9e5b-92028f9ca5c3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:13.940575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ccdd4-2cdf-4523-9e5b-92028f9ca5c3 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:13.942043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 35/67] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:13.947648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9e0e2-f7e0-45c1-bab3-56bd4da1f4ee None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:13.948098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9e0e2-f7e0-45c1-bab3-56bd4da1f4ee None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:13.948592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e9e0e2-f7e0-45c1-bab3-56bd4da1f4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:13.965626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-41e9e0e2-f7e0-45c1-bab3-56bd4da1f4ee None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:13.967368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-41e9e0e2-f7e0-45c1-bab3-56bd4da1f4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:13.992089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:13.999901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:14.024357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3989b46-3c1f-462e-bbf8-9ffeb8d4dc5f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.056364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 36/68] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:14.057672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9e0e2-f7e0-45c1-bab3-56bd4da1f4ee None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.073739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007cd62-9081-41ca-b019-de4ea7702f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.074428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007cd62-9081-41ca-b019-de4ea7702f71 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.074717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007cd62-9081-41ca-b019-de4ea7702f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.074997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007cd62-9081-41ca-b019-de4ea7702f71 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.075752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007cd62-9081-41ca-b019-de4ea7702f71 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:14.076211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007cd62-9081-41ca-b019-de4ea7702f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:14.078032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007cd62-9081-41ca-b019-de4ea7702f71 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:14.093052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 33/69] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:14.094687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1686-7de6-4239-b043-39e26b68093d None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.095115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1686-7de6-4239-b043-39e26b68093d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.095533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad1686-7de6-4239-b043-39e26b68093d None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.097262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 34/70] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:14.098678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1686-7de6-4239-b043-39e26b68093d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.168073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e9e0e2-f7e0-45c1-bab3-56bd4da1f4ee None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.208600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b99deae-3d7d-4213-8e21-1247cd7e41f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.209554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99deae-3d7d-4213-8e21-1247cd7e41f4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.209839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99deae-3d7d-4213-8e21-1247cd7e41f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.210113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b99deae-3d7d-4213-8e21-1247cd7e41f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.214750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad1686-7de6-4239-b043-39e26b68093d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.221874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b99deae-3d7d-4213-8e21-1247cd7e41f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-4b99deae-3d7d-4213-8e21-1247cd7e41f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:14.230156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:14.231005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:14.231740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 37/71] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:14.233244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c40d4-9faf-45e4-ab6f-81e26d14c478 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.233244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c40d4-9faf-45e4-ab6f-81e26d14c478 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.233244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c40d4-9faf-45e4-ab6f-81e26d14c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.251457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-199c40d4-9faf-45e4-ab6f-81e26d14c478 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:14.252698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-199c40d4-9faf-45e4-ab6f-81e26d14c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:14.258013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c3dd-9146-4371-ac45-a44b2da6867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.259543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c3dd-9146-4371-ac45-a44b2da6867d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.259948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c3dd-9146-4371-ac45-a44b2da6867d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.260230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5c3dd-9146-4371-ac45-a44b2da6867d None admin] PATH_INFO: `/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.262562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:14.264378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:14.279762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5c3dd-9146-4371-ac45-a44b2da6867d None admin] RBAC: Authorizing `identity:get_user(user_id=1ab4216474ef4cc89f2eee3dcc0873a3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:14.281295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed5c3dd-9146-4371-ac45-a44b2da6867d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:14.283321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 35/72] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:14.283884 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c3dd-9146-4371-ac45-a44b2da6867d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.327753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 38/73] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:14.328594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c40d4-9faf-45e4-ab6f-81e26d14c478 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.397990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5c3dd-9146-4371-ac45-a44b2da6867d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.437676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623eb57-8373-4baf-9eba-81e143596670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.438734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623eb57-8373-4baf-9eba-81e143596670 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.439020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623eb57-8373-4baf-9eba-81e143596670 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.439295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623eb57-8373-4baf-9eba-81e143596670 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.439799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c40d4-9faf-45e4-ab6f-81e26d14c478 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.450099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623eb57-8373-4baf-9eba-81e143596670 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f623eb57-8373-4baf-9eba-81e143596670 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:14.457865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:14.458716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:14.459467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 36/74] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:14.460082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623eb57-8373-4baf-9eba-81e143596670 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.479311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854513e8-5dde-4eda-b699-5135d5315c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.479983 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854513e8-5dde-4eda-b699-5135d5315c83 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.480266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854513e8-5dde-4eda-b699-5135d5315c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.480662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854513e8-5dde-4eda-b699-5135d5315c83 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.481433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854513e8-5dde-4eda-b699-5135d5315c83 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:14.481744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854513e8-5dde-4eda-b699-5135d5315c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:14.483149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854513e8-5dde-4eda-b699-5135d5315c83 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:14.491462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 39/75] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:14.492268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854513e8-5dde-4eda-b699-5135d5315c83 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.504978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:14.527602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:14.577667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623eb57-8373-4baf-9eba-81e143596670 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.598263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854513e8-5dde-4eda-b699-5135d5315c83 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.611241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2401a2-5eb4-4aed-97dd-189080570630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.611894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2401a2-5eb4-4aed-97dd-189080570630 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.612174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2401a2-5eb4-4aed-97dd-189080570630 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.612447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2401a2-5eb4-4aed-97dd-189080570630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.631109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395db0-e98a-4ec6-9ad6-049c924e03a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.631896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395db0-e98a-4ec6-9ad6-049c924e03a4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.632179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395db0-e98a-4ec6-9ad6-049c924e03a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.632451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06395db0-e98a-4ec6-9ad6-049c924e03a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.643043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06395db0-e98a-4ec6-9ad6-049c924e03a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-06395db0-e98a-4ec6-9ad6-049c924e03a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:14.650968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:14.651838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:14.652636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 40/76] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:14.653465 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395db0-e98a-4ec6-9ad6-049c924e03a4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.683281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2401a2-5eb4-4aed-97dd-189080570630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:14.684787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2401a2-5eb4-4aed-97dd-189080570630 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:14.717449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:14.734954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:14.750304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06395db0-e98a-4ec6-9ad6-049c924e03a4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.782460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 37/77] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:14.783299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2401a2-5eb4-4aed-97dd-189080570630 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.800021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1cf74-6b30-4c23-a52a-fb17d3a2035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.800621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1cf74-6b30-4c23-a52a-fb17d3a2035c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.800905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1cf74-6b30-4c23-a52a-fb17d3a2035c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.801180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1cf74-6b30-4c23-a52a-fb17d3a2035c None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.801926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1cf74-6b30-4c23-a52a-fb17d3a2035c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:14.802461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1cf74-6b30-4c23-a52a-fb17d3a2035c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:14.803619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d1cf74-6b30-4c23-a52a-fb17d3a2035c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:14.811696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 41/78] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:14.812934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fbfca-acee-474e-9e8a-c9e12671fad6 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.813220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fbfca-acee-474e-9e8a-c9e12671fad6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.813500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0fbfca-acee-474e-9e8a-c9e12671fad6 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.814880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 42/79] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:14.816906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fbfca-acee-474e-9e8a-c9e12671fad6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.883866 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2401a2-5eb4-4aed-97dd-189080570630 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.918106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119af0c-d741-4d88-8ea8-a23e859c0e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.918987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119af0c-d741-4d88-8ea8-a23e859c0e8c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.919268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119af0c-d741-4d88-8ea8-a23e859c0e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.919481 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0fbfca-acee-474e-9e8a-c9e12671fad6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:14.919591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f119af0c-d741-4d88-8ea8-a23e859c0e8c None admin] PATH_INFO: `/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.920757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119af0c-d741-4d88-8ea8-a23e859c0e8c None admin] RBAC: Authorizing `identity:get_user(user_id=1ab4216474ef4cc89f2eee3dcc0873a3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:14.922205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f119af0c-d741-4d88-8ea8-a23e859c0e8c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:14.923834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 38/80] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:14.924611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119af0c-d741-4d88-8ea8-a23e859c0e8c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:14.947246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:14.949236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:14.954728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d9184-c084-4686-a804-fa69f1045868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:14.955392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d9184-c084-4686-a804-fa69f1045868 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:14.955676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d9184-c084-4686-a804-fa69f1045868 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:14.955984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d9184-c084-4686-a804-fa69f1045868 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:14.962930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d9184-c084-4686-a804-fa69f1045868 None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:14.962930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d9184-c084-4686-a804-fa69f1045868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:14.962930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648d9184-c084-4686-a804-fa69f1045868 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:14.967728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 43/81] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:14.968671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d9184-c084-4686-a804-fa69f1045868 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:15.025788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f119af0c-d741-4d88-8ea8-a23e859c0e8c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:15.060852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c0448-557a-4f86-a06a-0476afb3b810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:15.061715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c0448-557a-4f86-a06a-0476afb3b810 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.062000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c0448-557a-4f86-a06a-0476afb3b810 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.062278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c0448-557a-4f86-a06a-0476afb3b810 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.063483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c0448-557a-4f86-a06a-0476afb3b810 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:15.064985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c0448-557a-4f86-a06a-0476afb3b810 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:15.066871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 39/82] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:15.067972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f3382-6cf9-474a-b7f6-a2a5ae20b83e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.068260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f3382-6cf9-474a-b7f6-a2a5ae20b83e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.068559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f3382-6cf9-474a-b7f6-a2a5ae20b83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.071709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d9184-c084-4686-a804-fa69f1045868 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:15.085540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-757f3382-6cf9-474a-b7f6-a2a5ae20b83e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:15.086835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-757f3382-6cf9-474a-b7f6-a2a5ae20b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:15.106383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5548af-fcb8-4aa9-b594-ad5b65de7c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:15.107254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5548af-fcb8-4aa9-b594-ad5b65de7c66 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.107533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5548af-fcb8-4aa9-b594-ad5b65de7c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.107802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5548af-fcb8-4aa9-b594-ad5b65de7c66 None admin] PATH_INFO: `/v3/users/91002622404a49918bac736d37052f04` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.109021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5548af-fcb8-4aa9-b594-ad5b65de7c66 None admin] RBAC: Authorizing `identity:get_user(user_id=91002622404a49918bac736d37052f04)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:15.110461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5548af-fcb8-4aa9-b594-ad5b65de7c66 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:15.112068 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 44/83] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:14 2022] GET /identity/v3/users/91002622404a49918bac736d37052f04 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:15.112925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5548af-fcb8-4aa9-b594-ad5b65de7c66 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:15.158040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 40/84] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:15.159140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f3382-6cf9-474a-b7f6-a2a5ae20b83e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:15.173263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:15.177449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:15.212964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5548af-fcb8-4aa9-b594-ad5b65de7c66 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:15.247170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc87062-ebe3-40f3-8e3a-2187988c7b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:15.247812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc87062-ebe3-40f3-8e3a-2187988c7b7e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.248097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc87062-ebe3-40f3-8e3a-2187988c7b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.248375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc87062-ebe3-40f3-8e3a-2187988c7b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.259216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f3382-6cf9-474a-b7f6-a2a5ae20b83e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:15.293702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d550a-af6f-4049-9ce7-5c28e0ed14b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:15.294580 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d550a-af6f-4049-9ce7-5c28e0ed14b0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.294865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d550a-af6f-4049-9ce7-5c28e0ed14b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.295149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d550a-af6f-4049-9ce7-5c28e0ed14b0 None admin] PATH_INFO: `/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.296367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d550a-af6f-4049-9ce7-5c28e0ed14b0 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab4216474ef4cc89f2eee3dcc0873a3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:15.297859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d550a-af6f-4049-9ce7-5c28e0ed14b0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:15.299500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 41/85] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:15 2022] GET /identity/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:15.300266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d550a-af6f-4049-9ce7-5c28e0ed14b0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:15.314287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc87062-ebe3-40f3-8e3a-2187988c7b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:15.315757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc87062-ebe3-40f3-8e3a-2187988c7b7e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:15.371200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:15.385044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:15.399424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d550a-af6f-4049-9ce7-5c28e0ed14b0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:15.411557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 45/86] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:15.412328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc87062-ebe3-40f3-8e3a-2187988c7b7e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:15.432980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32934b83-0011-4c7b-ad26-b9aaf9c28032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:15.433637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934b83-0011-4c7b-ad26-b9aaf9c28032 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.433920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934b83-0011-4c7b-ad26-b9aaf9c28032 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.434194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32934b83-0011-4c7b-ad26-b9aaf9c28032 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.435023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32934b83-0011-4c7b-ad26-b9aaf9c28032 None admin] RBAC: Adding query filter params (role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca, user.id=1ab4216474ef4cc89f2eee3dcc0873a3) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:15.435336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32934b83-0011-4c7b-ad26-b9aaf9c28032 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:15.436885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32934b83-0011-4c7b-ad26-b9aaf9c28032 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:15.456612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 42/87] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:15 2022] GET /identity/v3/role_assignments?user.id=1ab4216474ef4cc89f2eee3dcc0873a3&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:15.456612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32934b83-0011-4c7b-ad26-b9aaf9c28032 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:15.526523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc87062-ebe3-40f3-8e3a-2187988c7b7e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:15.566778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb100a-ae5b-4aa0-b48c-7681885b8503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:15.567674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb100a-ae5b-4aa0-b48c-7681885b8503 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.567786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb100a-ae5b-4aa0-b48c-7681885b8503 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.568006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb100a-ae5b-4aa0-b48c-7681885b8503 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.574614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32934b83-0011-4c7b-ad26-b9aaf9c28032 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:15.607450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:15.622272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676c6f8-7a6b-496b-bdbf-2240e2568a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:15.625126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676c6f8-7a6b-496b-bdbf-2240e2568a89 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.625126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676c6f8-7a6b-496b-bdbf-2240e2568a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.625126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c676c6f8-7a6b-496b-bdbf-2240e2568a89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.625610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676c6f8-7a6b-496b-bdbf-2240e2568a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:15.627063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c676c6f8-7a6b-496b-bdbf-2240e2568a89 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:15.628887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 43/88] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:15.643683 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676c6f8-7a6b-496b-bdbf-2240e2568a89 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:15.650567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb100a-ae5b-4aa0-b48c-7681885b8503 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:15.651166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:15.652512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb100a-ae5b-4aa0-b48c-7681885b8503 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:15.740040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c676c6f8-7a6b-496b-bdbf-2240e2568a89 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:15.766224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 46/89] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:15.766224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb100a-ae5b-4aa0-b48c-7681885b8503 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:15.784614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90edafd-6658-442d-8b97-ac4cabec957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:15.785278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90edafd-6658-442d-8b97-ac4cabec957e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.785565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90edafd-6658-442d-8b97-ac4cabec957e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.785844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90edafd-6658-442d-8b97-ac4cabec957e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.825741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:15.860548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90edafd-6658-442d-8b97-ac4cabec957e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:15.862027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90edafd-6658-442d-8b97-ac4cabec957e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:15.868626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb100a-ae5b-4aa0-b48c-7681885b8503 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:15.880523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:15.904185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b78ca-3d37-418e-ae9b-0ad2b8a674ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:15.905089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b78ca-3d37-418e-ae9b-0ad2b8a674ea None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:15.905372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b78ca-3d37-418e-ae9b-0ad2b8a674ea None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:15.905648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1b78ca-3d37-418e-ae9b-0ad2b8a674ea None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:15.906831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b78ca-3d37-418e-ae9b-0ad2b8a674ea None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:15.908294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1b78ca-3d37-418e-ae9b-0ad2b8a674ea None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:15.914788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 47/90] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:15 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:15.914788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b78ca-3d37-418e-ae9b-0ad2b8a674ea None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:15.972328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 44/91] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:15.973241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90edafd-6658-442d-8b97-ac4cabec957e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:16.022126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1b78ca-3d37-418e-ae9b-0ad2b8a674ea None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:16.050039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:16.058199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3443a-338e-43b8-bd02-78d1cef259a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:16.058980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3443a-338e-43b8-bd02-78d1cef259a8 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:16.059266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3443a-338e-43b8-bd02-78d1cef259a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:16.059542 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3443a-338e-43b8-bd02-78d1cef259a8 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:16.065055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3443a-338e-43b8-bd02-78d1cef259a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:16.065055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3443a-338e-43b8-bd02-78d1cef259a8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:16.080104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90edafd-6658-442d-8b97-ac4cabec957e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:16.098039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:16.115075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68393aa1-1ac9-4a0d-b164-3d09195b8e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:16.115947 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393aa1-1ac9-4a0d-b164-3d09195b8e8c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:16.116235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393aa1-1ac9-4a0d-b164-3d09195b8e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:16.116646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393aa1-1ac9-4a0d-b164-3d09195b8e8c None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:16.117834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68393aa1-1ac9-4a0d-b164-3d09195b8e8c None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:16.119435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68393aa1-1ac9-4a0d-b164-3d09195b8e8c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:16.121171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 45/92] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:15 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:16.121943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68393aa1-1ac9-4a0d-b164-3d09195b8e8c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:16.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 48/93] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:15:15 2022] POST /identity/v3/users => generated 289 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:16.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3443a-338e-43b8-bd02-78d1cef259a8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:16.259529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68393aa1-1ac9-4a0d-b164-3d09195b8e8c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:16.303249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2895f-c683-4c67-9c0f-ecfe59a7e581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:16.303846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2895f-c683-4c67-9c0f-ecfe59a7e581 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:16.304135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2895f-c683-4c67-9c0f-ecfe59a7e581 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:16.304418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2895f-c683-4c67-9c0f-ecfe59a7e581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:16.305469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2895f-c683-4c67-9c0f-ecfe59a7e581 None admin] RBAC: Adding query filter params (role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca, user.id=1ab4216474ef4cc89f2eee3dcc0873a3) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:16.305853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2895f-c683-4c67-9c0f-ecfe59a7e581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:16.307847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2895f-c683-4c67-9c0f-ecfe59a7e581 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:16.314460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 46/94] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:16 2022] GET /identity/v3/role_assignments?user.id=1ab4216474ef4cc89f2eee3dcc0873a3&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=3e26988f292a493c8351b566b43239e2 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:16.315446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2895f-c683-4c67-9c0f-ecfe59a7e581 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:16.318940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3443a-338e-43b8-bd02-78d1cef259a8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:16.370299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317a709-a2c8-4cf4-a709-d16922decc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:16.371196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317a709-a2c8-4cf4-a709-d16922decc60 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:16.371476 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317a709-a2c8-4cf4-a709-d16922decc60 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:16.371751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317a709-a2c8-4cf4-a709-d16922decc60 None admin] PATH_INFO: `/v3/projects/00efc5073c084a41abdf2cf63d1c3a67` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:16.373200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317a709-a2c8-4cf4-a709-d16922decc60 None admin] RBAC: Authorizing `identity:get_project(project_id=00efc5073c084a41abdf2cf63d1c3a67)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:16.374814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317a709-a2c8-4cf4-a709-d16922decc60 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:16.376709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 49/95] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:16 2022] GET /identity/v3/projects/00efc5073c084a41abdf2cf63d1c3a67 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:16.377941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:16.383330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317a709-a2c8-4cf4-a709-d16922decc60 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:16.441521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2895f-c683-4c67-9c0f-ecfe59a7e581 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:16.454548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:16.481177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef756a-d042-40ac-a27d-8246d9df398a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:16.481995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef756a-d042-40ac-a27d-8246d9df398a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:16.482382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef756a-d042-40ac-a27d-8246d9df398a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:16.482750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef756a-d042-40ac-a27d-8246d9df398a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:16.483687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef756a-d042-40ac-a27d-8246d9df398a None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca, user.id=91002622404a49918bac736d37052f04) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:16.484071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef756a-d042-40ac-a27d-8246d9df398a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:16.485661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef756a-d042-40ac-a27d-8246d9df398a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:16.492203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 47/96] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:16 2022] GET /identity/v3/role_assignments?user.id=91002622404a49918bac736d37052f04&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=7c09d078126441909df0a46212ffea63 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:16.519148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317a709-a2c8-4cf4-a709-d16922decc60 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:16.563949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa277832-1e42-4f8f-9f22-8a59bc50d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:16.564589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa277832-1e42-4f8f-9f22-8a59bc50d8ae None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:16.564880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa277832-1e42-4f8f-9f22-8a59bc50d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:16.565161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa277832-1e42-4f8f-9f22-8a59bc50d8ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:16.566026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa277832-1e42-4f8f-9f22-8a59bc50d8ae None admin] RBAC: Adding query filter params (role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=00efc5073c084a41abdf2cf63d1c3a67, user.id=1ab4216474ef4cc89f2eee3dcc0873a3) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:16.566346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa277832-1e42-4f8f-9f22-8a59bc50d8ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:16.567861 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa277832-1e42-4f8f-9f22-8a59bc50d8ae None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:16.574926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 50/97] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:16 2022] GET /identity/v3/role_assignments?user.id=1ab4216474ef4cc89f2eee3dcc0873a3&scope.project.id=00efc5073c084a41abdf2cf63d1c3a67&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:17.940946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567ac3-2b65-4d55-bf63-0eba74b68fa8 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:17.941434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567ac3-2b65-4d55-bf63-0eba74b68fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:17.941530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a567ac3-2b65-4d55-bf63-0eba74b68fa8 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:17.942870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 48/98] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:17.949085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e894862-5caf-4ff2-bcdf-f92321023ce9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:17.949594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e894862-5caf-4ff2-bcdf-f92321023ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:17.949845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e894862-5caf-4ff2-bcdf-f92321023ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:17.971486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6e894862-5caf-4ff2-bcdf-f92321023ce9 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:17.972697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6e894862-5caf-4ff2-bcdf-f92321023ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:18.051111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 51/99] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:18.092293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567ac3-2b65-4d55-bf63-0eba74b68fa8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:18.209250 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a567ac3-2b65-4d55-bf63-0eba74b68fa8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:18.224505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:18.256693 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68f64b-b5d0-4d0d-99ad-15e6384e0658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:18.257511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68f64b-b5d0-4d0d-99ad-15e6384e0658 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:18.257802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68f64b-b5d0-4d0d-99ad-15e6384e0658 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:18.258379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68f64b-b5d0-4d0d-99ad-15e6384e0658 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:18.277422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68f64b-b5d0-4d0d-99ad-15e6384e0658 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ff68f64b-b5d0-4d0d-99ad-15e6384e0658 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:18.285348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:18.286217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:18.286986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 49/100] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:18.292870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e894862-5caf-4ff2-bcdf-f92321023ce9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:18.362352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:18.433673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e894862-5caf-4ff2-bcdf-f92321023ce9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:18.482550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef2a4b-895f-4bd4-8d24-979b05de7946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:18.483583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef2a4b-895f-4bd4-8d24-979b05de7946 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:18.484082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef2a4b-895f-4bd4-8d24-979b05de7946 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:18.484579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef2a4b-895f-4bd4-8d24-979b05de7946 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:18.485539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef2a4b-895f-4bd4-8d24-979b05de7946 None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:18.486049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef2a4b-895f-4bd4-8d24-979b05de7946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:18.487675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef2a4b-895f-4bd4-8d24-979b05de7946 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:18.501156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 52/101] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:18.506522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68f64b-b5d0-4d0d-99ad-15e6384e0658 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:18.652900 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68f64b-b5d0-4d0d-99ad-15e6384e0658 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:18.694706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce63a66-7b84-4226-9859-69461effac38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:18.696291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63a66-7b84-4226-9859-69461effac38 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:18.696844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63a66-7b84-4226-9859-69461effac38 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:18.697141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce63a66-7b84-4226-9859-69461effac38 None admin] PATH_INFO: `/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:18.701240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce63a66-7b84-4226-9859-69461effac38 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab4216474ef4cc89f2eee3dcc0873a3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:18.702790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce63a66-7b84-4226-9859-69461effac38 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:18.704464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 50/102] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:18 2022] GET /identity/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3 => generated 275 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:18.710097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef2a4b-895f-4bd4-8d24-979b05de7946 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:18.843748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef2a4b-895f-4bd4-8d24-979b05de7946 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:18.858180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:18.893234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7609a629-e131-4ac5-acad-5304019fd408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:18.894160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609a629-e131-4ac5-acad-5304019fd408 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:18.894454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609a629-e131-4ac5-acad-5304019fd408 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:18.894737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7609a629-e131-4ac5-acad-5304019fd408 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:18.895964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609a629-e131-4ac5-acad-5304019fd408 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:18.897570 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7609a629-e131-4ac5-acad-5304019fd408 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:18.900324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 53/103] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:18 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:18.906851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce63a66-7b84-4226-9859-69461effac38 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:18.973535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:19.050334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce63a66-7b84-4226-9859-69461effac38 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:19.100145 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b75bd7-5cf6-4bde-9d9a-45bb681d961b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:19.101022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b75bd7-5cf6-4bde-9d9a-45bb681d961b None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:19.101311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b75bd7-5cf6-4bde-9d9a-45bb681d961b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:19.101595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b75bd7-5cf6-4bde-9d9a-45bb681d961b None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/users/1ab4216474ef4cc89f2eee3dcc0873a3/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:19.110301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b75bd7-5cf6-4bde-9d9a-45bb681d961b None admin] RBAC: Authorizing `identity:create_grant(project_id=f8518c8e5e874ff6806e967ca32ffaca, user_id=1ab4216474ef4cc89f2eee3dcc0873a3, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:19.111818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b75bd7-5cf6-4bde-9d9a-45bb681d961b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:19.191267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 51/104] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:15:18 2022] PUT /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/users/1ab4216474ef4cc89f2eee3dcc0873a3/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:19.502209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673228ac-dc24-4872-b48c-706150ae81dd None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:19.502713 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673228ac-dc24-4872-b48c-706150ae81dd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:19.502980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673228ac-dc24-4872-b48c-706150ae81dd None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:19.504231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 54/105] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:19.518559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dbeb2-5421-4a81-8e20-eb412ba8a715 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:19.518861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dbeb2-5421-4a81-8e20-eb412ba8a715 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:19.519147 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7dbeb2-5421-4a81-8e20-eb412ba8a715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:19.545745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fc7dbeb2-5421-4a81-8e20-eb412ba8a715 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:19.547400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fc7dbeb2-5421-4a81-8e20-eb412ba8a715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:19.629339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 52/106] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:19.653153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363081f-7eef-4c64-88a7-cbe2d96ee30a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:19.653442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363081f-7eef-4c64-88a7-cbe2d96ee30a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:19.653727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363081f-7eef-4c64-88a7-cbe2d96ee30a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:19.655421 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 55/107] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:19.661044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20067-f26b-4a18-a4d0-0320eb2403e2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:19.661336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20067-f26b-4a18-a4d0-0320eb2403e2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:19.661617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b20067-f26b-4a18-a4d0-0320eb2403e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:19.668247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363081f-7eef-4c64-88a7-cbe2d96ee30a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:19.690475 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-72b20067-f26b-4a18-a4d0-0320eb2403e2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:19.691767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-72b20067-f26b-4a18-a4d0-0320eb2403e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:19.742175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:19.826234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363081f-7eef-4c64-88a7-cbe2d96ee30a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:19.871070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 53/108] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:19.884119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a12f0-6d19-4e7a-b115-7d3a0fe44b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:19.885291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a12f0-6d19-4e7a-b115-7d3a0fe44b8d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:19.885791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a12f0-6d19-4e7a-b115-7d3a0fe44b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:19.886277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a12f0-6d19-4e7a-b115-7d3a0fe44b8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:19.902787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a12f0-6d19-4e7a-b115-7d3a0fe44b8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-5d7a12f0-6d19-4e7a-b115-7d3a0fe44b8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:19.911171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:19.912085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:19.912880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:19.913446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c57630-57e9-4d5b-8785-2c4da2040a5c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:19.913446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c57630-57e9-4d5b-8785-2c4da2040a5c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:19.913446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c57630-57e9-4d5b-8785-2c4da2040a5c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:19.916388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 56/110] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:15:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:19.917433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 54/110] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:19.917756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a12f0-6d19-4e7a-b115-7d3a0fe44b8d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:19.923315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e0fe-fbf6-4660-9f83-b280b3acd8ae None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:19.923315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e0fe-fbf6-4660-9f83-b280b3acd8ae None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:19.923315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e4e0fe-fbf6-4660-9f83-b280b3acd8ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:19.940239 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-57e4e0fe-fbf6-4660-9f83-b280b3acd8ae None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:19.941806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-57e4e0fe-fbf6-4660-9f83-b280b3acd8ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:19.994406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:20.049798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 55/111] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:20.050722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e0fe-fbf6-4660-9f83-b280b3acd8ae None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:20.137982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a12f0-6d19-4e7a-b115-7d3a0fe44b8d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:20.154625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:20.171124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e4e0fe-fbf6-4660-9f83-b280b3acd8ae None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:20.190212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2d26-87c8-42a3-bf86-a7550935f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:20.191524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2d26-87c8-42a3-bf86-a7550935f8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.192283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2d26-87c8-42a3-bf86-a7550935f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.192786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c2d26-87c8-42a3-bf86-a7550935f8f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.207693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c2d26-87c8-42a3-bf86-a7550935f8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:20.212571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0551dd-8fb0-4c69-b4c7-f15fb748037f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:20.213457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0551dd-8fb0-4c69-b4c7-f15fb748037f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.213869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0551dd-8fb0-4c69-b4c7-f15fb748037f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.214258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0551dd-8fb0-4c69-b4c7-f15fb748037f None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.215164 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0551dd-8fb0-4c69-b4c7-f15fb748037f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:20.215565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0551dd-8fb0-4c69-b4c7-f15fb748037f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:20.217462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0551dd-8fb0-4c69-b4c7-f15fb748037f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-d52c2d26-87c8-42a3-bf86-a7550935f8f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:20.217654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:20.218698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:20.219643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:20.222675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 57/112] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:20.223728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2d26-87c8-42a3-bf86-a7550935f8f1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:20.231189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 56/113] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:20.232696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a394b-607e-4ee6-9f23-0a64ab21ca8f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.233054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a394b-607e-4ee6-9f23-0a64ab21ca8f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.233403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8a394b-607e-4ee6-9f23-0a64ab21ca8f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.234917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 57/114] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:20.239364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a394b-607e-4ee6-9f23-0a64ab21ca8f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:20.345981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:20.354053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c2d26-87c8-42a3-bf86-a7550935f8f1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:20.365619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8a394b-607e-4ee6-9f23-0a64ab21ca8f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:20.392226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d7e9f-515f-4436-9ac5-981516949a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:20.393539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d7e9f-515f-4436-9ac5-981516949a5c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.394136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d7e9f-515f-4436-9ac5-981516949a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.394853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d7e9f-515f-4436-9ac5-981516949a5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.403388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52267686-93cd-4115-a194-2dde2617b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:20.404065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52267686-93cd-4115-a194-2dde2617b465 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.404352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52267686-93cd-4115-a194-2dde2617b465 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.404725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52267686-93cd-4115-a194-2dde2617b465 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.405467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52267686-93cd-4115-a194-2dde2617b465 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:20.405830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52267686-93cd-4115-a194-2dde2617b465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:20.407304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52267686-93cd-4115-a194-2dde2617b465 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:20.409375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d7e9f-515f-4436-9ac5-981516949a5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:20.417730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 58/115] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:20.418887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52267686-93cd-4115-a194-2dde2617b465 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3d3d7e9f-515f-4436-9ac5-981516949a5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:20.419939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:20.421036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:20.421886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:20.424893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 58/116] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:20.426291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ded24-0eb9-4b22-9bc7-9407fe430ef4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.426727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ded24-0eb9-4b22-9bc7-9407fe430ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.427238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ded24-0eb9-4b22-9bc7-9407fe430ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.440781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:20.451256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-377ded24-0eb9-4b22-9bc7-9407fe430ef4 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:20.453059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-377ded24-0eb9-4b22-9bc7-9407fe430ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:20.532075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52267686-93cd-4115-a194-2dde2617b465 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:20.540525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 59/117] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:20.544886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ded24-0eb9-4b22-9bc7-9407fe430ef4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:20.575871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c78cd8-41ff-4554-a146-782d3866e492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:20.576769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c78cd8-41ff-4554-a146-782d3866e492 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.577055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c78cd8-41ff-4554-a146-782d3866e492 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.577331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c78cd8-41ff-4554-a146-782d3866e492 None admin] PATH_INFO: `/v3/users/91002622404a49918bac736d37052f04` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.578527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c78cd8-41ff-4554-a146-782d3866e492 None admin] RBAC: Authorizing `identity:get_user(user_id=91002622404a49918bac736d37052f04)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:20.579987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c78cd8-41ff-4554-a146-782d3866e492 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:20.583463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 59/118] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/users/91002622404a49918bac736d37052f04 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:20.583463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c78cd8-41ff-4554-a146-782d3866e492 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:20.654665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:20.669692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ded24-0eb9-4b22-9bc7-9407fe430ef4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:20.675937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:20.695704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c78cd8-41ff-4554-a146-782d3866e492 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:20.703719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f8b42-a577-4cbc-8f12-2a2e00f89a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:20.704642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f8b42-a577-4cbc-8f12-2a2e00f89a19 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.704930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f8b42-a577-4cbc-8f12-2a2e00f89a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.705264 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f8b42-a577-4cbc-8f12-2a2e00f89a19 None admin] PATH_INFO: `/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.706473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f8b42-a577-4cbc-8f12-2a2e00f89a19 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab4216474ef4cc89f2eee3dcc0873a3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:20.707942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f8b42-a577-4cbc-8f12-2a2e00f89a19 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:20.709808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 60/119] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:20.711024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f95b20-9532-4560-bbfd-e558549f2411 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.711480 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f95b20-9532-4560-bbfd-e558549f2411 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.711826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f95b20-9532-4560-bbfd-e558549f2411 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.713222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 61/120] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:20.718852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f95b20-9532-4560-bbfd-e558549f2411 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:20.739614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2dc79-6cf0-4a4f-b1e4-05131a2228ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:20.740534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2dc79-6cf0-4a4f-b1e4-05131a2228ba None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.740829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2dc79-6cf0-4a4f-b1e4-05131a2228ba None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.741126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2dc79-6cf0-4a4f-b1e4-05131a2228ba None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.741868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2dc79-6cf0-4a4f-b1e4-05131a2228ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:20.742181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2dc79-6cf0-4a4f-b1e4-05131a2228ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:20.743660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e2dc79-6cf0-4a4f-b1e4-05131a2228ba None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:20.751741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 60/121] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:20.752558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2dc79-6cf0-4a4f-b1e4-05131a2228ba None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:20.837120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f95b20-9532-4560-bbfd-e558549f2411 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:20.862164 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2dc79-6cf0-4a4f-b1e4-05131a2228ba None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:20.875028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291efdee-0fd1-40a4-95eb-a982003dbeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:20.875859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291efdee-0fd1-40a4-95eb-a982003dbeee None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.876139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291efdee-0fd1-40a4-95eb-a982003dbeee None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.876426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291efdee-0fd1-40a4-95eb-a982003dbeee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.887791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291efdee-0fd1-40a4-95eb-a982003dbeee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-291efdee-0fd1-40a4-95eb-a982003dbeee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:20.895702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:20.896588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:20.897359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 62/122] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:20.898023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291efdee-0fd1-40a4-95eb-a982003dbeee None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:20.903441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fd63b-e142-4d47-804c-5f0bd6d4a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:20.904328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fd63b-e142-4d47-804c-5f0bd6d4a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.904646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fd63b-e142-4d47-804c-5f0bd6d4a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.904976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fd63b-e142-4d47-804c-5f0bd6d4a1a0 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.906134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fd63b-e142-4d47-804c-5f0bd6d4a1a0 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:20.907607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fd63b-e142-4d47-804c-5f0bd6d4a1a0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:20.909356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 61/123] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:20.910579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec8e65-6335-4418-bca1-72767b0568ca None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:20.910872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec8e65-6335-4418-bca1-72767b0568ca None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:20.911150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec8e65-6335-4418-bca1-72767b0568ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:20.920675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:20.928990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a8ec8e65-6335-4418-bca1-72767b0568ca None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:20.936823 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a8ec8e65-6335-4418-bca1-72767b0568ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:20.940001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:20.998761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 62/124] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:20.999817 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec8e65-6335-4418-bca1-72767b0568ca None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:21.022131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291efdee-0fd1-40a4-95eb-a982003dbeee None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:21.058099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ad95-dd34-45c2-92ef-a6342584abbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:21.058992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ad95-dd34-45c2-92ef-a6342584abbe None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:21.059276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ad95-dd34-45c2-92ef-a6342584abbe None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:21.059567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f15ad95-dd34-45c2-92ef-a6342584abbe None admin] PATH_INFO: `/v3/projects/00efc5073c084a41abdf2cf63d1c3a67` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:21.060765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15ad95-dd34-45c2-92ef-a6342584abbe None admin] RBAC: Authorizing `identity:get_project(project_id=00efc5073c084a41abdf2cf63d1c3a67)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:21.062224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f15ad95-dd34-45c2-92ef-a6342584abbe None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:21.063918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 63/125] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/projects/00efc5073c084a41abdf2cf63d1c3a67 => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:21.064779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ad95-dd34-45c2-92ef-a6342584abbe None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:21.111759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec8e65-6335-4418-bca1-72767b0568ca None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:21.147379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:21.151278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd161f1-6054-4326-88ca-0adbb20c9874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:21.152159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd161f1-6054-4326-88ca-0adbb20c9874 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:21.152444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd161f1-6054-4326-88ca-0adbb20c9874 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:21.152765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd161f1-6054-4326-88ca-0adbb20c9874 None admin] PATH_INFO: `/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:21.153962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd161f1-6054-4326-88ca-0adbb20c9874 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab4216474ef4cc89f2eee3dcc0873a3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:21.159850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd161f1-6054-4326-88ca-0adbb20c9874 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:21.159850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 63/126] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:20 2022] GET /identity/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:21.159850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd161f1-6054-4326-88ca-0adbb20c9874 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:21.171654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f15ad95-dd34-45c2-92ef-a6342584abbe None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:21.176813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:21.208905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc0e1-5fe8-4f4f-93cc-c26f98206376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:21.209583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc0e1-5fe8-4f4f-93cc-c26f98206376 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:21.209869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc0e1-5fe8-4f4f-93cc-c26f98206376 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:21.210145 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91bc0e1-5fe8-4f4f-93cc-c26f98206376 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:21.210900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bc0e1-5fe8-4f4f-93cc-c26f98206376 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:21.211255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bc0e1-5fe8-4f4f-93cc-c26f98206376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:21.212842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91bc0e1-5fe8-4f4f-93cc-c26f98206376 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:21.221343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 64/127] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:21.225347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc0e1-5fe8-4f4f-93cc-c26f98206376 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:21.270263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd161f1-6054-4326-88ca-0adbb20c9874 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:21.306976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17cfa0-b7e8-4f8b-80bf-c5f6e090f393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:21.307890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17cfa0-b7e8-4f8b-80bf-c5f6e090f393 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:21.308226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17cfa0-b7e8-4f8b-80bf-c5f6e090f393 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:21.308572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db17cfa0-b7e8-4f8b-80bf-c5f6e090f393 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/users/91002622404a49918bac736d37052f04/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:21.310583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17cfa0-b7e8-4f8b-80bf-c5f6e090f393 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8518c8e5e874ff6806e967ca32ffaca, user_id=91002622404a49918bac736d37052f04, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:21.312064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db17cfa0-b7e8-4f8b-80bf-c5f6e090f393 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:21.330951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91bc0e1-5fe8-4f4f-93cc-c26f98206376 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:21.364620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc58c7d-b017-4062-9d82-5c4d850ddcc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:21.365421 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc58c7d-b017-4062-9d82-5c4d850ddcc3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:21.365775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc58c7d-b017-4062-9d82-5c4d850ddcc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:21.366048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc58c7d-b017-4062-9d82-5c4d850ddcc3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:21.367232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc58c7d-b017-4062-9d82-5c4d850ddcc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:21.368728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc58c7d-b017-4062-9d82-5c4d850ddcc3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:21.370337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 65/128] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:21.371067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc58c7d-b017-4062-9d82-5c4d850ddcc3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:21.385984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:21.416289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 64/129] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:15:21 2022] PUT /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/users/91002622404a49918bac736d37052f04/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:21.424703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17cfa0-b7e8-4f8b-80bf-c5f6e090f393 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:21.490539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc58c7d-b017-4062-9d82-5c4d850ddcc3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:21.527489 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:21.532323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c61dc7-eb04-4f73-a4eb-5e18a9da5846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:21.533556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c61dc7-eb04-4f73-a4eb-5e18a9da5846 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:21.533995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c61dc7-eb04-4f73-a4eb-5e18a9da5846 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:21.534284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c61dc7-eb04-4f73-a4eb-5e18a9da5846 None admin] PATH_INFO: `/v3/projects/00efc5073c084a41abdf2cf63d1c3a67/users/1ab4216474ef4cc89f2eee3dcc0873a3/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:21.536563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c61dc7-eb04-4f73-a4eb-5e18a9da5846 None admin] RBAC: Authorizing `identity:create_grant(project_id=00efc5073c084a41abdf2cf63d1c3a67, user_id=1ab4216474ef4cc89f2eee3dcc0873a3, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:21.538146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c61dc7-eb04-4f73-a4eb-5e18a9da5846 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:21.562091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db17cfa0-b7e8-4f8b-80bf-c5f6e090f393 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:21.607599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ea80-ccba-4a3c-a09d-45909c3d3df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:21.608514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ea80-ccba-4a3c-a09d-45909c3d3df0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:21.608779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ea80-ccba-4a3c-a09d-45909c3d3df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:21.609056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c91ea80-ccba-4a3c-a09d-45909c3d3df0 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:21.610298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91ea80-ccba-4a3c-a09d-45909c3d3df0 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:21.611757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c91ea80-ccba-4a3c-a09d-45909c3d3df0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:21.618600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 65/130] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:21 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:21.618600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ea80-ccba-4a3c-a09d-45909c3d3df0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:21.625381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 66/131] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:15:21 2022] PUT /identity/v3/projects/00efc5073c084a41abdf2cf63d1c3a67/users/1ab4216474ef4cc89f2eee3dcc0873a3/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:21.626130 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c61dc7-eb04-4f73-a4eb-5e18a9da5846 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:21.748631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c91ea80-ccba-4a3c-a09d-45909c3d3df0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:21.781322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:21.800276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803afa9-1110-4303-be9c-3ec1b9816f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:21.801515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803afa9-1110-4303-be9c-3ec1b9816f35 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:21.801808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803afa9-1110-4303-be9c-3ec1b9816f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:21.802074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803afa9-1110-4303-be9c-3ec1b9816f35 None admin] PATH_INFO: `/v3/users/0ef14c81f3ee4b15bf034d2a3dbfd1cd` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:21.816127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c61dc7-eb04-4f73-a4eb-5e18a9da5846 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:21.826811 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:21.833252 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803afa9-1110-4303-be9c-3ec1b9816f35 None admin] RBAC: Authorizing `identity:get_user(user_id=0ef14c81f3ee4b15bf034d2a3dbfd1cd)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:21.834752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8803afa9-1110-4303-be9c-3ec1b9816f35 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:21.836893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 66/132] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:21 2022] GET /identity/v3/users/0ef14c81f3ee4b15bf034d2a3dbfd1cd => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:21.837494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803afa9-1110-4303-be9c-3ec1b9816f35 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:21.861905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b48af2-d18c-4029-9afa-a5899711d958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:21.862594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b48af2-d18c-4029-9afa-a5899711d958 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:21.862884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b48af2-d18c-4029-9afa-a5899711d958 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:21.863163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b48af2-d18c-4029-9afa-a5899711d958 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:21.863927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b48af2-d18c-4029-9afa-a5899711d958 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:21.865634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b48af2-d18c-4029-9afa-a5899711d958 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:21.957938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 67/133] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:15:21 2022] POST /identity/v3/projects => generated 302 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:21.958875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b48af2-d18c-4029-9afa-a5899711d958 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:22.046355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803afa9-1110-4303-be9c-3ec1b9816f35 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:22.125381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66e57f-ce77-41a1-9ed6-63ce2d44b931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:22.127152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66e57f-ce77-41a1-9ed6-63ce2d44b931 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:22.128685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66e57f-ce77-41a1-9ed6-63ce2d44b931 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:22.129521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66e57f-ce77-41a1-9ed6-63ce2d44b931 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/users/1ab4216474ef4cc89f2eee3dcc0873a3/roles/3e26988f292a493c8351b566b43239e2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:22.134974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66e57f-ce77-41a1-9ed6-63ce2d44b931 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8518c8e5e874ff6806e967ca32ffaca, user_id=1ab4216474ef4cc89f2eee3dcc0873a3, role_id=3e26988f292a493c8351b566b43239e2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:22.138874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66e57f-ce77-41a1-9ed6-63ce2d44b931 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:22.159351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b48af2-d18c-4029-9afa-a5899711d958 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:22.187115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:22.199309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9429-9a1e-443a-bc69-9b32a0cb35f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:22.200024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9429-9a1e-443a-bc69-9b32a0cb35f8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:22.200341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9429-9a1e-443a-bc69-9b32a0cb35f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:22.200677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a9429-9a1e-443a-bc69-9b32a0cb35f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:22.250775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 67/134] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:15:21 2022] PUT /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/users/1ab4216474ef4cc89f2eee3dcc0873a3/roles/3e26988f292a493c8351b566b43239e2 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:22.252322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476269c-ae91-4659-ba33-d81fd26e5285 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:22.252687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476269c-ae91-4659-ba33-d81fd26e5285 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:22.252968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476269c-ae91-4659-ba33-d81fd26e5285 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:22.254364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 68/135] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:22.261010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c0a59-3ab3-4292-a956-6b1b2239e837 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:22.261010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c0a59-3ab3-4292-a956-6b1b2239e837 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:22.261010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c0a59-3ab3-4292-a956-6b1b2239e837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:22.282435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-750c0a59-3ab3-4292-a956-6b1b2239e837 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:22.283971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-750c0a59-3ab3-4292-a956-6b1b2239e837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:22.290252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a9429-9a1e-443a-bc69-9b32a0cb35f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:22.295859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a9429-9a1e-443a-bc69-9b32a0cb35f8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:22.386338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:22.403829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 69/136] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:22.434320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c0a59-3ab3-4292-a956-6b1b2239e837 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:22.555205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 68/137] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:22.561424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9429-9a1e-443a-bc69-9b32a0cb35f8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:22.606924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c0a59-3ab3-4292-a956-6b1b2239e837 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:22.619072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:22.687292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0020b6-4315-46f6-a5cc-f50036a9357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:22.688029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0020b6-4315-46f6-a5cc-f50036a9357b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:22.688308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0020b6-4315-46f6-a5cc-f50036a9357b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:22.688616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0020b6-4315-46f6-a5cc-f50036a9357b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:22.710263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0020b6-4315-46f6-a5cc-f50036a9357b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ca0020b6-4315-46f6-a5cc-f50036a9357b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:22.719231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:22.720133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:22.720976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 70/138] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:22.729811 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0020b6-4315-46f6-a5cc-f50036a9357b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:22.735437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a9429-9a1e-443a-bc69-9b32a0cb35f8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:22.798272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcef16-5931-4f9d-a35b-8ea2aaedec3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:22.799144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcef16-5931-4f9d-a35b-8ea2aaedec3c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:22.799424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcef16-5931-4f9d-a35b-8ea2aaedec3c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:22.799699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbcef16-5931-4f9d-a35b-8ea2aaedec3c None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:22.800939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcef16-5931-4f9d-a35b-8ea2aaedec3c None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:22.802417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbcef16-5931-4f9d-a35b-8ea2aaedec3c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:22.804314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 69/139] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:22 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:22.818724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcef16-5931-4f9d-a35b-8ea2aaedec3c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:22.837438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:22.946994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0020b6-4315-46f6-a5cc-f50036a9357b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:23.013178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615adf2-20e8-4529-8fe1-cd345b21a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:23.013869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615adf2-20e8-4529-8fe1-cd345b21a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:23.014152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615adf2-20e8-4529-8fe1-cd345b21a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:23.014428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615adf2-20e8-4529-8fe1-cd345b21a3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:23.015183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615adf2-20e8-4529-8fe1-cd345b21a3a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:23.015488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615adf2-20e8-4529-8fe1-cd345b21a3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:23.016903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615adf2-20e8-4529-8fe1-cd345b21a3a9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:23.038603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 71/140] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:23.045114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615adf2-20e8-4529-8fe1-cd345b21a3a9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:23.046901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:23.076252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbcef16-5931-4f9d-a35b-8ea2aaedec3c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:23.147322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b29956-053c-4fcb-bbcd-31c6ec1e179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:23.148395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29956-053c-4fcb-bbcd-31c6ec1e179f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:23.149224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29956-053c-4fcb-bbcd-31c6ec1e179f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:23.149712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b29956-053c-4fcb-bbcd-31c6ec1e179f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:23.150756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b29956-053c-4fcb-bbcd-31c6ec1e179f None admin] RBAC: Adding query filter params (role.id=546050dd0a7a4c989b85134c093336a9, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca, user.id=0ef14c81f3ee4b15bf034d2a3dbfd1cd) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:23.151274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b29956-053c-4fcb-bbcd-31c6ec1e179f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:23.152988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b29956-053c-4fcb-bbcd-31c6ec1e179f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:23.165723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 70/141] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:22 2022] GET /identity/v3/role_assignments?user.id=0ef14c81f3ee4b15bf034d2a3dbfd1cd&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=546050dd0a7a4c989b85134c093336a9 => generated 259 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:23.254409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615adf2-20e8-4529-8fe1-cd345b21a3a9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:23.276164 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:23.313146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083aa99-2eba-4314-bdeb-d810ab0fdd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:23.314034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083aa99-2eba-4314-bdeb-d810ab0fdd3b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:23.314318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083aa99-2eba-4314-bdeb-d810ab0fdd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:23.314591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083aa99-2eba-4314-bdeb-d810ab0fdd3b None admin] PATH_INFO: `/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:23.315797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083aa99-2eba-4314-bdeb-d810ab0fdd3b None admin] RBAC: Authorizing `identity:get_user(user_id=1ab4216474ef4cc89f2eee3dcc0873a3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:23.317292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083aa99-2eba-4314-bdeb-d810ab0fdd3b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:23.318925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 72/142] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:23 2022] GET /identity/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:23.325629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b29956-053c-4fcb-bbcd-31c6ec1e179f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:23.474593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b29956-053c-4fcb-bbcd-31c6ec1e179f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:23.528951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d8a89-d7e0-4dee-9fa0-ce934c1460eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:23.529973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d8a89-d7e0-4dee-9fa0-ce934c1460eb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:23.530468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d8a89-d7e0-4dee-9fa0-ce934c1460eb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:23.530935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d8a89-d7e0-4dee-9fa0-ce934c1460eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:23.562563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:23.627913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d8a89-d7e0-4dee-9fa0-ce934c1460eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:23.629436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d8a89-d7e0-4dee-9fa0-ce934c1460eb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:23.759758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 71/143] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:23.766131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083aa99-2eba-4314-bdeb-d810ab0fdd3b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:23.921630 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083aa99-2eba-4314-bdeb-d810ab0fdd3b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:23.970095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94d8d5-e636-4202-8872-c5282607eac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:23.970975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d8d5-e636-4202-8872-c5282607eac3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:23.971257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d8d5-e636-4202-8872-c5282607eac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:23.971543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94d8d5-e636-4202-8872-c5282607eac3 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:23.972765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94d8d5-e636-4202-8872-c5282607eac3 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:23.974222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94d8d5-e636-4202-8872-c5282607eac3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:23.976074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 73/144] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:23 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:23.982636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d8a89-d7e0-4dee-9fa0-ce934c1460eb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:24.075999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:24.133473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d8a89-d7e0-4dee-9fa0-ce934c1460eb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:24.183383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9733fd6a-25df-43a2-b5e0-8ed53160dd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:24.183967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733fd6a-25df-43a2-b5e0-8ed53160dd3d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:24.184253 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733fd6a-25df-43a2-b5e0-8ed53160dd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:24.184556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9733fd6a-25df-43a2-b5e0-8ed53160dd3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:24.185394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733fd6a-25df-43a2-b5e0-8ed53160dd3d None admin] RBAC: Adding query filter params (role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca, user.id=1ab4216474ef4cc89f2eee3dcc0873a3) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:24.185708 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733fd6a-25df-43a2-b5e0-8ed53160dd3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:24.187158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9733fd6a-25df-43a2-b5e0-8ed53160dd3d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:24.193640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 72/145] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:23 2022] GET /identity/v3/role_assignments?user.id=1ab4216474ef4cc89f2eee3dcc0873a3&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:24.535691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317a1a-cf81-4033-8467-e542839828eb None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:24.536208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317a1a-cf81-4033-8467-e542839828eb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:24.536312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317a1a-cf81-4033-8467-e542839828eb None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:24.537818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 74/146] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:24.543969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc63c80-8c55-40d9-a938-2caf2b25500c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:24.544391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc63c80-8c55-40d9-a938-2caf2b25500c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:24.544793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc63c80-8c55-40d9-a938-2caf2b25500c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:24.566316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6dc63c80-8c55-40d9-a938-2caf2b25500c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:24.567500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6dc63c80-8c55-40d9-a938-2caf2b25500c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:24.658650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 73/147] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:24.699794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317a1a-cf81-4033-8467-e542839828eb None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:24.740336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb67e79-7ed7-4d80-99cb-47fd9900e85f None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:24.740686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb67e79-7ed7-4d80-99cb-47fd9900e85f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:24.740928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb67e79-7ed7-4d80-99cb-47fd9900e85f None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:24.742970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 74/148] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:24.751331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10183895-c5ea-4760-98c6-cf3f067b979c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:24.751331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10183895-c5ea-4760-98c6-cf3f067b979c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:24.751331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10183895-c5ea-4760-98c6-cf3f067b979c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:24.771671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-10183895-c5ea-4760-98c6-cf3f067b979c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:24.773898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-10183895-c5ea-4760-98c6-cf3f067b979c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:24.776003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:24.834753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:24.855644 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 75/149] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:24.885634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10183895-c5ea-4760-98c6-cf3f067b979c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:24.902237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317a1a-cf81-4033-8467-e542839828eb None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:24.972856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652abddc-7b39-4854-b202-0e6f0ac9404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:24.973673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652abddc-7b39-4854-b202-0e6f0ac9404a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:24.973954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652abddc-7b39-4854-b202-0e6f0ac9404a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:24.974231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652abddc-7b39-4854-b202-0e6f0ac9404a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:24.998436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652abddc-7b39-4854-b202-0e6f0ac9404a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:25.003997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10183895-c5ea-4760-98c6-cf3f067b979c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-652abddc-7b39-4854-b202-0e6f0ac9404a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:25.014455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:25.015382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:25.016150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 75/150] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:15:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:25.024275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652abddc-7b39-4854-b202-0e6f0ac9404a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:25.041059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925f5bc-159d-4724-8da2-5226af7c134d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:25.041880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925f5bc-159d-4724-8da2-5226af7c134d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.042163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925f5bc-159d-4724-8da2-5226af7c134d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.042437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f925f5bc-159d-4724-8da2-5226af7c134d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.053906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f925f5bc-159d-4724-8da2-5226af7c134d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f925f5bc-159d-4724-8da2-5226af7c134d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:25.063751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:25.064684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:25.065620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 76/151] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:25.072021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925f5bc-159d-4724-8da2-5226af7c134d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:25.117623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:25.185955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652abddc-7b39-4854-b202-0e6f0ac9404a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:25.193001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:25.195597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f925f5bc-159d-4724-8da2-5226af7c134d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:25.229735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415eca9b-482d-4031-bff1-d4c2b32ebd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:25.231636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eca9b-482d-4031-bff1-d4c2b32ebd59 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.231929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eca9b-482d-4031-bff1-d4c2b32ebd59 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.232203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415eca9b-482d-4031-bff1-d4c2b32ebd59 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.234484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415eca9b-482d-4031-bff1-d4c2b32ebd59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:25.234797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415eca9b-482d-4031-bff1-d4c2b32ebd59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:25.236193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415eca9b-482d-4031-bff1-d4c2b32ebd59 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:25.255949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 76/152] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:25.257520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af715-5a33-4043-afce-6f0d5248bd67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:25.258287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af715-5a33-4043-afce-6f0d5248bd67 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.258568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af715-5a33-4043-afce-6f0d5248bd67 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.258844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68af715-5a33-4043-afce-6f0d5248bd67 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.259640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68af715-5a33-4043-afce-6f0d5248bd67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:25.259950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68af715-5a33-4043-afce-6f0d5248bd67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:25.261612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415eca9b-482d-4031-bff1-d4c2b32ebd59 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:25.266643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68af715-5a33-4043-afce-6f0d5248bd67 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:25.285943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 77/153] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:25.292747 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af715-5a33-4043-afce-6f0d5248bd67 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:25.461813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415eca9b-482d-4031-bff1-d4c2b32ebd59 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:25.481023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68af715-5a33-4043-afce-6f0d5248bd67 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:25.484812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:25.531673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da354a-24e0-4018-b1ca-02089c66d5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:25.532591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da354a-24e0-4018-b1ca-02089c66d5d4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.532874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da354a-24e0-4018-b1ca-02089c66d5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.533153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da354a-24e0-4018-b1ca-02089c66d5d4 None admin] PATH_INFO: `/v3/users/91002622404a49918bac736d37052f04` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.535190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da354a-24e0-4018-b1ca-02089c66d5d4 None admin] RBAC: Authorizing `identity:get_user(user_id=91002622404a49918bac736d37052f04)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:25.537203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da354a-24e0-4018-b1ca-02089c66d5d4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:25.541111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 77/154] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:25 2022] GET /identity/v3/users/91002622404a49918bac736d37052f04 => generated 247 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:25.541871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d03f86-cf11-4737-b3ca-8346142e1dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:25.542766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d03f86-cf11-4737-b3ca-8346142e1dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.543048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d03f86-cf11-4737-b3ca-8346142e1dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.543321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d03f86-cf11-4737-b3ca-8346142e1dc1 None admin] PATH_INFO: `/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.544586 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d03f86-cf11-4737-b3ca-8346142e1dc1 None admin] RBAC: Authorizing `identity:get_user(user_id=1ab4216474ef4cc89f2eee3dcc0873a3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:25.546139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d03f86-cf11-4737-b3ca-8346142e1dc1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:25.547922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 78/155] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:25 2022] GET /identity/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3 => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:25.548688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da354a-24e0-4018-b1ca-02089c66d5d4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:25.555196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d03f86-cf11-4737-b3ca-8346142e1dc1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:25.590127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:25.658507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da354a-24e0-4018-b1ca-02089c66d5d4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:25.674612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d03f86-cf11-4737-b3ca-8346142e1dc1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:25.693562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34e60d8-00da-451d-9d8a-b07e6a4a97db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:25.694221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e60d8-00da-451d-9d8a-b07e6a4a97db None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.694503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e60d8-00da-451d-9d8a-b07e6a4a97db None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.694777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34e60d8-00da-451d-9d8a-b07e6a4a97db None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.711693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318c608-ecd8-41ab-88fa-7699dccd4b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:25.712397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318c608-ecd8-41ab-88fa-7699dccd4b7e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.712660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318c608-ecd8-41ab-88fa-7699dccd4b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.712938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318c608-ecd8-41ab-88fa-7699dccd4b7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.753028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:25.769903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e60d8-00da-451d-9d8a-b07e6a4a97db None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:25.771374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34e60d8-00da-451d-9d8a-b07e6a4a97db None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:25.782065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318c608-ecd8-41ab-88fa-7699dccd4b7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:25.783518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318c608-ecd8-41ab-88fa-7699dccd4b7e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:25.807071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:25.881064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 78/156] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:25.882408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d678a6f-7fe3-41b6-961c-eae2e1fa65d4 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.882754 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d678a6f-7fe3-41b6-961c-eae2e1fa65d4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.883681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d678a6f-7fe3-41b6-961c-eae2e1fa65d4 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.885216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 79/157] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:25.889900 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b99d0-b003-440b-a742-a67c455cd9ac None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.890195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b99d0-b003-440b-a742-a67c455cd9ac None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.890481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b99d0-b003-440b-a742-a67c455cd9ac None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.891809 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 80/158] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:25.892633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b99d0-b003-440b-a742-a67c455cd9ac None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:25.900578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 79/159] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:15:25.901773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b3fb4-715d-462f-91d4-54101e9a61d7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:25.902062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b3fb4-715d-462f-91d4-54101e9a61d7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:25.902340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b3fb4-715d-462f-91d4-54101e9a61d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:25.925308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f46b3fb4-715d-462f-91d4-54101e9a61d7 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:25.926518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f46b3fb4-715d-462f-91d4-54101e9a61d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:25.994549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:26.008504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 80/160] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:26.008504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8957c5-6b8d-414f-892f-1e3099c1146e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.008504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8957c5-6b8d-414f-892f-1e3099c1146e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.008504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8957c5-6b8d-414f-892f-1e3099c1146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.017038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b99d0-b003-440b-a742-a67c455cd9ac None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:26.026153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-dd8957c5-6b8d-414f-892f-1e3099c1146e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:26.027466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dd8957c5-6b8d-414f-892f-1e3099c1146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:26.052755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f432ab-051f-4421-8a49-0675a68a01a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:26.053621 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f432ab-051f-4421-8a49-0675a68a01a1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.053912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f432ab-051f-4421-8a49-0675a68a01a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.054188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f432ab-051f-4421-8a49-0675a68a01a1 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.055733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f432ab-051f-4421-8a49-0675a68a01a1 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:26.057227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f432ab-051f-4421-8a49-0675a68a01a1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:26.058937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 81/161] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:25 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:26.059698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f432ab-051f-4421-8a49-0675a68a01a1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.065942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:26.105443 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 81/162] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:26.106824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8957c5-6b8d-414f-892f-1e3099c1146e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.173621 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f432ab-051f-4421-8a49-0675a68a01a1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:26.207324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1784800-781d-4244-a24f-bff66a4935f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:26.208180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1784800-781d-4244-a24f-bff66a4935f6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.208460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1784800-781d-4244-a24f-bff66a4935f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.208757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1784800-781d-4244-a24f-bff66a4935f6 None admin] PATH_INFO: `/v3/projects/00efc5073c084a41abdf2cf63d1c3a67` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.209925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1784800-781d-4244-a24f-bff66a4935f6 None admin] RBAC: Authorizing `identity:get_project(project_id=00efc5073c084a41abdf2cf63d1c3a67)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:26.210280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8957c5-6b8d-414f-892f-1e3099c1146e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:26.212049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1784800-781d-4244-a24f-bff66a4935f6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:26.213859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 82/163] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:26 2022] GET /identity/v3/projects/00efc5073c084a41abdf2cf63d1c3a67 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:26.213859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1784800-781d-4244-a24f-bff66a4935f6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.244392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:26.250095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea1df3-f065-469a-a3f3-5825b9b88610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:26.250871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1df3-f065-469a-a3f3-5825b9b88610 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.251157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1df3-f065-469a-a3f3-5825b9b88610 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.251433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea1df3-f065-469a-a3f3-5825b9b88610 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.262099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea1df3-f065-469a-a3f3-5825b9b88610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-52ea1df3-f065-469a-a3f3-5825b9b88610 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:26.270302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:26.271169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:26.271990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 82/164] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:26.272904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4849ac-7a1d-4466-aa89-6a0f43d3de47 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.273074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4849ac-7a1d-4466-aa89-6a0f43d3de47 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.273374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4849ac-7a1d-4466-aa89-6a0f43d3de47 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.275559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 83/165] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:26.276269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4849ac-7a1d-4466-aa89-6a0f43d3de47 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.288719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:26.317830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1784800-781d-4244-a24f-bff66a4935f6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:26.352859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3606a-5143-4104-9ab1-196dd08ec3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:26.353508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3606a-5143-4104-9ab1-196dd08ec3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.353793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3606a-5143-4104-9ab1-196dd08ec3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.354068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3606a-5143-4104-9ab1-196dd08ec3a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.354901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3606a-5143-4104-9ab1-196dd08ec3a1 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca, user.id=91002622404a49918bac736d37052f04) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:26.355214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3606a-5143-4104-9ab1-196dd08ec3a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:26.356678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3606a-5143-4104-9ab1-196dd08ec3a1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:26.362479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 83/166] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:26 2022] GET /identity/v3/role_assignments?user.id=91002622404a49918bac736d37052f04&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=7c09d078126441909df0a46212ffea63 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:26.364359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3606a-5143-4104-9ab1-196dd08ec3a1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.391787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4849ac-7a1d-4466-aa89-6a0f43d3de47 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:26.432208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad88db6-b9ab-4aa4-9d11-80e1e02bf72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:26.433676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad88db6-b9ab-4aa4-9d11-80e1e02bf72c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.434185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad88db6-b9ab-4aa4-9d11-80e1e02bf72c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.434695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad88db6-b9ab-4aa4-9d11-80e1e02bf72c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.436970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad88db6-b9ab-4aa4-9d11-80e1e02bf72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:26.439728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad88db6-b9ab-4aa4-9d11-80e1e02bf72c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:26.446858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 84/167] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:26.446858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad88db6-b9ab-4aa4-9d11-80e1e02bf72c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.485241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3606a-5143-4104-9ab1-196dd08ec3a1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:26.515095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:26.522294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cf33a-de72-4df4-81b3-abc42afaa319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:26.523175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cf33a-de72-4df4-81b3-abc42afaa319 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.524053 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cf33a-de72-4df4-81b3-abc42afaa319 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.524328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cf33a-de72-4df4-81b3-abc42afaa319 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.526385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cf33a-de72-4df4-81b3-abc42afaa319 None admin] RBAC: Adding query filter params (role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=00efc5073c084a41abdf2cf63d1c3a67, user.id=1ab4216474ef4cc89f2eee3dcc0873a3) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:26.526385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cf33a-de72-4df4-81b3-abc42afaa319 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:26.527392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cf33a-de72-4df4-81b3-abc42afaa319 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:26.531020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:26.544508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 84/168] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:26 2022] GET /identity/v3/role_assignments?user.id=1ab4216474ef4cc89f2eee3dcc0873a3&scope.project.id=00efc5073c084a41abdf2cf63d1c3a67&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:26.544508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042914-ba58-43ea-b40f-62beb39c01f8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.544508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042914-ba58-43ea-b40f-62beb39c01f8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.544508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe042914-ba58-43ea-b40f-62beb39c01f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.555439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fe042914-ba58-43ea-b40f-62beb39c01f8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:26.556886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fe042914-ba58-43ea-b40f-62beb39c01f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:26.595546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad88db6-b9ab-4aa4-9d11-80e1e02bf72c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:26.639738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ba41-579c-41ae-a3d5-5b86518d7ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:26.640423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ba41-579c-41ae-a3d5-5b86518d7ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.640757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ba41-579c-41ae-a3d5-5b86518d7ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.641035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c7ba41-579c-41ae-a3d5-5b86518d7ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.641812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7ba41-579c-41ae-a3d5-5b86518d7ab5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:26.642122 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7ba41-579c-41ae-a3d5-5b86518d7ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:26.643534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c7ba41-579c-41ae-a3d5-5b86518d7ab5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:26.654171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 85/169] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:26.654609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ba41-579c-41ae-a3d5-5b86518d7ab5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.655202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 85/170] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:26.661701 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042914-ba58-43ea-b40f-62beb39c01f8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.786596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c7ba41-579c-41ae-a3d5-5b86518d7ab5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:26.787599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe042914-ba58-43ea-b40f-62beb39c01f8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:26.809047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:26.823668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:26.823928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a78870-cae1-4e1e-a35a-1abd314b7290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:26.824800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a78870-cae1-4e1e-a35a-1abd314b7290 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.825091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a78870-cae1-4e1e-a35a-1abd314b7290 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.825368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a78870-cae1-4e1e-a35a-1abd314b7290 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.829404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a78870-cae1-4e1e-a35a-1abd314b7290 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:26.829404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a78870-cae1-4e1e-a35a-1abd314b7290 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:26.829575 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccafe06-5204-44ab-9fa9-14c65a5ba37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:26.829881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccafe06-5204-44ab-9fa9-14c65a5ba37c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:26.830160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccafe06-5204-44ab-9fa9-14c65a5ba37c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:26.830430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccafe06-5204-44ab-9fa9-14c65a5ba37c None admin] PATH_INFO: `/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:26.831618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccafe06-5204-44ab-9fa9-14c65a5ba37c None admin] RBAC: Authorizing `identity:get_user(user_id=1ab4216474ef4cc89f2eee3dcc0873a3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:26.833082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccafe06-5204-44ab-9fa9-14c65a5ba37c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:26.834708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 86/171] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:26 2022] GET /identity/v3/users/1ab4216474ef4cc89f2eee3dcc0873a3 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:26.835568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccafe06-5204-44ab-9fa9-14c65a5ba37c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.923764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 86/172] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:15:26 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:26.925315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a78870-cae1-4e1e-a35a-1abd314b7290 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:26.940381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccafe06-5204-44ab-9fa9-14c65a5ba37c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:27.001112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5b0ee-3f9b-40ba-8e77-ec182826f812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:27.002401 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5b0ee-3f9b-40ba-8e77-ec182826f812 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:27.002913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5b0ee-3f9b-40ba-8e77-ec182826f812 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:27.003257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df5b0ee-3f9b-40ba-8e77-ec182826f812 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:27.021101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df5b0ee-3f9b-40ba-8e77-ec182826f812 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9df5b0ee-3f9b-40ba-8e77-ec182826f812 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:27.029499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:27.030512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:27.031299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 87/173] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:27.036773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5b0ee-3f9b-40ba-8e77-ec182826f812 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:27.075472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a78870-cae1-4e1e-a35a-1abd314b7290 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:27.106459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:27.118336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c888986-ec43-4927-b372-ed1fd883ba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:27.121497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c888986-ec43-4927-b372-ed1fd883ba05 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:27.121497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c888986-ec43-4927-b372-ed1fd883ba05 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:27.121497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c888986-ec43-4927-b372-ed1fd883ba05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:27.158008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df5b0ee-3f9b-40ba-8e77-ec182826f812 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:27.177610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:27.203669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522843d-7728-4080-9adc-21eb4aeae70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:27.204352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522843d-7728-4080-9adc-21eb4aeae70b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:27.204682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522843d-7728-4080-9adc-21eb4aeae70b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:27.204964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e522843d-7728-4080-9adc-21eb4aeae70b None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:27.206236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522843d-7728-4080-9adc-21eb4aeae70b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:27.206236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522843d-7728-4080-9adc-21eb4aeae70b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:27.207403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e522843d-7728-4080-9adc-21eb4aeae70b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:27.212722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c888986-ec43-4927-b372-ed1fd883ba05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:27.214277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c888986-ec43-4927-b372-ed1fd883ba05 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:27.224258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 88/174] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:27.230663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522843d-7728-4080-9adc-21eb4aeae70b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:27.343961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 87/175] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:27.349548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c888986-ec43-4927-b372-ed1fd883ba05 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:27.366320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e522843d-7728-4080-9adc-21eb4aeae70b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:27.393779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:27.413844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0eac2-d7bd-4f15-ad22-5ffaaf0af4eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:27.414924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0eac2-d7bd-4f15-ad22-5ffaaf0af4eb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:27.415230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0eac2-d7bd-4f15-ad22-5ffaaf0af4eb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:27.415426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0eac2-d7bd-4f15-ad22-5ffaaf0af4eb None admin] PATH_INFO: `/v3/users/0ef14c81f3ee4b15bf034d2a3dbfd1cd` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:27.416742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0eac2-d7bd-4f15-ad22-5ffaaf0af4eb None admin] RBAC: Authorizing `identity:get_user(user_id=0ef14c81f3ee4b15bf034d2a3dbfd1cd)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:27.418379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0eac2-d7bd-4f15-ad22-5ffaaf0af4eb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:27.420232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 89/176] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:27 2022] GET /identity/v3/users/0ef14c81f3ee4b15bf034d2a3dbfd1cd => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:27.425537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0eac2-d7bd-4f15-ad22-5ffaaf0af4eb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:27.455336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:27.484943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c888986-ec43-4927-b372-ed1fd883ba05 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:27.524811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f2f9f-7ebf-4397-9980-bc7ab3542f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:27.525699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f2f9f-7ebf-4397-9980-bc7ab3542f22 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:27.525983 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f2f9f-7ebf-4397-9980-bc7ab3542f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:27.526260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f2f9f-7ebf-4397-9980-bc7ab3542f22 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:27.527501 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f2f9f-7ebf-4397-9980-bc7ab3542f22 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:27.529036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f2f9f-7ebf-4397-9980-bc7ab3542f22 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:27.531075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 88/177] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:27 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:27.537127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f2f9f-7ebf-4397-9980-bc7ab3542f22 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:27.555745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0eac2-d7bd-4f15-ad22-5ffaaf0af4eb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:27.608870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c7293-b26e-4286-a6e1-ace80980856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:27.609802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c7293-b26e-4286-a6e1-ace80980856b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:27.610088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c7293-b26e-4286-a6e1-ace80980856b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:27.610363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c7293-b26e-4286-a6e1-ace80980856b None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:27.611799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c7293-b26e-4286-a6e1-ace80980856b None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:27.613295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c7293-b26e-4286-a6e1-ace80980856b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:27.615144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 90/178] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:27 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:27.621193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c7293-b26e-4286-a6e1-ace80980856b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:27.679594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f2f9f-7ebf-4397-9980-bc7ab3542f22 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:27.683168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:27.722955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d931ae3-fe1d-442b-9c26-78b9fbd1972c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:27.724059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d931ae3-fe1d-442b-9c26-78b9fbd1972c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:27.724569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d931ae3-fe1d-442b-9c26-78b9fbd1972c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:27.725199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d931ae3-fe1d-442b-9c26-78b9fbd1972c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:27.726662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d931ae3-fe1d-442b-9c26-78b9fbd1972c None admin] RBAC: Adding query filter params (role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca, user.id=1ab4216474ef4cc89f2eee3dcc0873a3) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:27.727193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d931ae3-fe1d-442b-9c26-78b9fbd1972c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:27.728884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d931ae3-fe1d-442b-9c26-78b9fbd1972c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:27.736441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 89/179] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:27 2022] GET /identity/v3/role_assignments?user.id=1ab4216474ef4cc89f2eee3dcc0873a3&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=3e26988f292a493c8351b566b43239e2 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:27.769354 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c7293-b26e-4286-a6e1-ace80980856b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:27.810300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea115a-da38-4742-be3b-461e7038c181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:27.811632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea115a-da38-4742-be3b-461e7038c181 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:27.812136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea115a-da38-4742-be3b-461e7038c181 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:27.812649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea115a-da38-4742-be3b-461e7038c181 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/users/0ef14c81f3ee4b15bf034d2a3dbfd1cd/roles/546050dd0a7a4c989b85134c093336a9` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:27.815084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea115a-da38-4742-be3b-461e7038c181 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8518c8e5e874ff6806e967ca32ffaca, user_id=0ef14c81f3ee4b15bf034d2a3dbfd1cd, role_id=546050dd0a7a4c989b85134c093336a9)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:27.816859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea115a-da38-4742-be3b-461e7038c181 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:27.906325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 91/180] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:15:27 2022] PUT /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/users/0ef14c81f3ee4b15bf034d2a3dbfd1cd/roles/546050dd0a7a4c989b85134c093336a9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:29.405662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e913c4-dead-4752-bb26-d16d65e6083e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:29.406674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e913c4-dead-4752-bb26-d16d65e6083e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:29.407161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e913c4-dead-4752-bb26-d16d65e6083e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:29.408800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 90/181] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:29.414085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d790de-20c9-406a-9dd4-ce450834799b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:29.414494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d790de-20c9-406a-9dd4-ce450834799b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:29.414697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d790de-20c9-406a-9dd4-ce450834799b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:29.431932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-51d790de-20c9-406a-9dd4-ce450834799b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:29.433144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-51d790de-20c9-406a-9dd4-ce450834799b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:29.504075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 92/182] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:29.527357 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e913c4-dead-4752-bb26-d16d65e6083e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:29.540335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:29.540519 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f5162-1ba6-4f29-a6eb-ba4432042155 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:29.540725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f5162-1ba6-4f29-a6eb-ba4432042155 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:29.540974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2f5162-1ba6-4f29-a6eb-ba4432042155 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:29.542347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 93/183] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:29.547899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb8dd4-5699-4327-911a-7a749ea77d6d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:29.548184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb8dd4-5699-4327-911a-7a749ea77d6d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:29.548459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb8dd4-5699-4327-911a-7a749ea77d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:29.568748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6dfb8dd4-5699-4327-911a-7a749ea77d6d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:29.571567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6dfb8dd4-5699-4327-911a-7a749ea77d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:29.633296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:29.659545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e913c4-dead-4752-bb26-d16d65e6083e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:29.660307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 94/184] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:29.683808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb8dd4-5699-4327-911a-7a749ea77d6d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:29.699767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094c58-1767-43fc-a047-7f6f80daf51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:29.701059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094c58-1767-43fc-a047-7f6f80daf51a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:29.701492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094c58-1767-43fc-a047-7f6f80daf51a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:29.702046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad094c58-1767-43fc-a047-7f6f80daf51a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:29.716165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad094c58-1767-43fc-a047-7f6f80daf51a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ad094c58-1767-43fc-a047-7f6f80daf51a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:29.726856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:29.728131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:29.729177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:29.731668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 91/185] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:29.738612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094c58-1767-43fc-a047-7f6f80daf51a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:29.801684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb8dd4-5699-4327-911a-7a749ea77d6d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:29.823868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:29.840331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ad428-4d41-43d9-94b6-11dfc348caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:29.841172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad428-4d41-43d9-94b6-11dfc348caaa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:29.841450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad428-4d41-43d9-94b6-11dfc348caaa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:29.841973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ad428-4d41-43d9-94b6-11dfc348caaa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:29.853384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ad428-4d41-43d9-94b6-11dfc348caaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:29.857894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad094c58-1767-43fc-a047-7f6f80daf51a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-4a3ad428-4d41-43d9-94b6-11dfc348caaa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:29.861508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:29.862478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:29.863260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:29.867648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 95/186] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:29.868880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919ce3-4835-4864-90fc-1a01f968082f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:29.869169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919ce3-4835-4864-90fc-1a01f968082f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:29.869599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51919ce3-4835-4864-90fc-1a01f968082f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:29.870855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 96/187] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:29.871478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51919ce3-4835-4864-90fc-1a01f968082f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:29.899349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecefbf5-5d4b-468c-8bef-3a9f7f943ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:29.900035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecefbf5-5d4b-468c-8bef-3a9f7f943ad2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:29.900317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecefbf5-5d4b-468c-8bef-3a9f7f943ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:29.900634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecefbf5-5d4b-468c-8bef-3a9f7f943ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:29.901393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecefbf5-5d4b-468c-8bef-3a9f7f943ad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:29.901704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecefbf5-5d4b-468c-8bef-3a9f7f943ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:29.903097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecefbf5-5d4b-468c-8bef-3a9f7f943ad2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:29.911082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:29.911833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 92/188] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:29.913240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04559b7-9045-4fb1-b4e7-1d0158785ea5 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:29.913534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04559b7-9045-4fb1-b4e7-1d0158785ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:29.914451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04559b7-9045-4fb1-b4e7-1d0158785ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:29.931814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c04559b7-9045-4fb1-b4e7-1d0158785ea5 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:29.933034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c04559b7-9045-4fb1-b4e7-1d0158785ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:29.983436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51919ce3-4835-4864-90fc-1a01f968082f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:30.005650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 93/189] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:30.006404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04559b7-9045-4fb1-b4e7-1d0158785ea5 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:30.026277 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1dd0-cc57-4438-8563-46694b03b658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:30.027901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1dd0-cc57-4438-8563-46694b03b658 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.028382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1dd0-cc57-4438-8563-46694b03b658 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.028895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e1dd0-cc57-4438-8563-46694b03b658 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.030129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1dd0-cc57-4438-8563-46694b03b658 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:30.030434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1dd0-cc57-4438-8563-46694b03b658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:30.032702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6e1dd0-cc57-4438-8563-46694b03b658 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:30.043390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 97/190] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:30.044221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1dd0-cc57-4438-8563-46694b03b658 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:30.075692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:30.119195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04559b7-9045-4fb1-b4e7-1d0158785ea5 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:30.154047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:30.157721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6e1dd0-cc57-4438-8563-46694b03b658 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:30.161572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c56fb-6c69-4feb-b56e-961e14ed1a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:30.162810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c56fb-6c69-4feb-b56e-961e14ed1a76 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.163289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c56fb-6c69-4feb-b56e-961e14ed1a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.163727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c56fb-6c69-4feb-b56e-961e14ed1a76 None admin] PATH_INFO: `/v3/users/0a0891a7651c4a599e480d3d26b6b3fe` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.178259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c56fb-6c69-4feb-b56e-961e14ed1a76 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0891a7651c4a599e480d3d26b6b3fe)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:30.180860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c56fb-6c69-4feb-b56e-961e14ed1a76 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:30.182861 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 94/191] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:30 2022] GET /identity/v3/users/0a0891a7651c4a599e480d3d26b6b3fe => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:30.183812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c56fb-6c69-4feb-b56e-961e14ed1a76 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:30.196980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf2e93-ce82-4e25-ae9a-6d2e7c92c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:30.197779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf2e93-ce82-4e25-ae9a-6d2e7c92c508 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.198059 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf2e93-ce82-4e25-ae9a-6d2e7c92c508 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.200647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaf2e93-ce82-4e25-ae9a-6d2e7c92c508 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.200647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf2e93-ce82-4e25-ae9a-6d2e7c92c508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:30.201033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaf2e93-ce82-4e25-ae9a-6d2e7c92c508 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:30.202654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 98/192] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:30.203409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf2e93-ce82-4e25-ae9a-6d2e7c92c508 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:30.299423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c56fb-6c69-4feb-b56e-961e14ed1a76 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:30.312083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaf2e93-ce82-4e25-ae9a-6d2e7c92c508 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:30.318903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:30.336907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591627a-f3bf-4357-a0a3-678566f493a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:30.337783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591627a-f3bf-4357-a0a3-678566f493a9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.338093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591627a-f3bf-4357-a0a3-678566f493a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.338351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591627a-f3bf-4357-a0a3-678566f493a9 None admin] PATH_INFO: `/v3/users/0a0891a7651c4a599e480d3d26b6b3fe` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.339507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591627a-f3bf-4357-a0a3-678566f493a9 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0891a7651c4a599e480d3d26b6b3fe)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:30.340980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5591627a-f3bf-4357-a0a3-678566f493a9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:30.342869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 95/193] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:30 2022] GET /identity/v3/users/0a0891a7651c4a599e480d3d26b6b3fe => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:30.343603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591627a-f3bf-4357-a0a3-678566f493a9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:30.349990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bda4c1-f86f-42f8-9bdd-cb1e9f36ad2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:30.350642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bda4c1-f86f-42f8-9bdd-cb1e9f36ad2c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.350927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bda4c1-f86f-42f8-9bdd-cb1e9f36ad2c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.351204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bda4c1-f86f-42f8-9bdd-cb1e9f36ad2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.385670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:30.418555 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bda4c1-f86f-42f8-9bdd-cb1e9f36ad2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:30.420244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bda4c1-f86f-42f8-9bdd-cb1e9f36ad2c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:30.441495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591627a-f3bf-4357-a0a3-678566f493a9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:30.530088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914842b-9f59-4af8-8844-3a75741563d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:30.530760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914842b-9f59-4af8-8844-3a75741563d9 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.531041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914842b-9f59-4af8-8844-3a75741563d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.531319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914842b-9f59-4af8-8844-3a75741563d9 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.532026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914842b-9f59-4af8-8844-3a75741563d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:30.533503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914842b-9f59-4af8-8844-3a75741563d9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:30.562159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 99/194] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:30.563627 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7b2a-1284-45ac-8508-7571bffa7fd6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.563917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7b2a-1284-45ac-8508-7571bffa7fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.564189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa7b2a-1284-45ac-8508-7571bffa7fd6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.565532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 100/195] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:30.566266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7b2a-1284-45ac-8508-7571bffa7fd6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:30.631737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:30.660389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 96/196] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:15:30 2022] POST /identity/v3/users => generated 297 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:30.661309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914842b-9f59-4af8-8844-3a75741563d9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:30.672534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa7b2a-1284-45ac-8508-7571bffa7fd6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:30.709582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:30.715316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd47d3-64ec-4e2a-a96d-fb3a7ef55392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:30.715993 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd47d3-64ec-4e2a-a96d-fb3a7ef55392 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.716275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd47d3-64ec-4e2a-a96d-fb3a7ef55392 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.716618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd47d3-64ec-4e2a-a96d-fb3a7ef55392 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.775781 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914842b-9f59-4af8-8844-3a75741563d9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:30.803875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd47d3-64ec-4e2a-a96d-fb3a7ef55392 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:30.807061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd47d3-64ec-4e2a-a96d-fb3a7ef55392 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:30.813323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489f960-e183-402b-bb71-6919a70b7df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:30.814207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f960-e183-402b-bb71-6919a70b7df0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.814488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f960-e183-402b-bb71-6919a70b7df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.814764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489f960-e183-402b-bb71-6919a70b7df0 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.816054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489f960-e183-402b-bb71-6919a70b7df0 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:30.817576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c489f960-e183-402b-bb71-6919a70b7df0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:30.819339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 97/197] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:30 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:30.821774 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0563cff-9e15-4644-a78d-5ad6747ec17e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:30.822057 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0563cff-9e15-4644-a78d-5ad6747ec17e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:30.822331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0563cff-9e15-4644-a78d-5ad6747ec17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:30.840215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c0563cff-9e15-4644-a78d-5ad6747ec17e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:30.842204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c0563cff-9e15-4644-a78d-5ad6747ec17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:30.898133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:30.923576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 98/198] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:30.926074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0563cff-9e15-4644-a78d-5ad6747ec17e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:30.950946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 101/199] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:30.950946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd47d3-64ec-4e2a-a96d-fb3a7ef55392 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:30.982894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:31.056374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0563cff-9e15-4644-a78d-5ad6747ec17e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:31.078023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd47d3-64ec-4e2a-a96d-fb3a7ef55392 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:31.095429 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa84806-534f-47fa-bc86-59485d64fa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:31.096290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84806-534f-47fa-bc86-59485d64fa1a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:31.096666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84806-534f-47fa-bc86-59485d64fa1a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:31.097014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84806-534f-47fa-bc86-59485d64fa1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:31.098052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa84806-534f-47fa-bc86-59485d64fa1a None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d, user.id=0a0891a7651c4a599e480d3d26b6b3fe) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:31.098429 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa84806-534f-47fa-bc86-59485d64fa1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:31.099965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa84806-534f-47fa-bc86-59485d64fa1a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:31.106325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 99/200] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:30 2022] GET /identity/v3/role_assignments?user.id=0a0891a7651c4a599e480d3d26b6b3fe&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=7c09d078126441909df0a46212ffea63 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:31.107269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa84806-534f-47fa-bc86-59485d64fa1a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:31.121160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347164-4f18-4a89-994e-9f36f075d330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:31.122264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347164-4f18-4a89-994e-9f36f075d330 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:31.122720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347164-4f18-4a89-994e-9f36f075d330 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:31.123189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf347164-4f18-4a89-994e-9f36f075d330 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:31.137306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf347164-4f18-4a89-994e-9f36f075d330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-cf347164-4f18-4a89-994e-9f36f075d330 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:31.146858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:31.147807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:31.148990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:31.151176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 102/201] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:31.160726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347164-4f18-4a89-994e-9f36f075d330 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:31.220532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:31.317578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa84806-534f-47fa-bc86-59485d64fa1a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:31.320772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:31.376830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf347164-4f18-4a89-994e-9f36f075d330 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:31.378205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e8fe2-3ea9-495a-b997-4650da2606df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:31.379110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e8fe2-3ea9-495a-b997-4650da2606df None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:31.379387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e8fe2-3ea9-495a-b997-4650da2606df None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:31.379656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e8fe2-3ea9-495a-b997-4650da2606df None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:31.380999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e8fe2-3ea9-495a-b997-4650da2606df None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:31.383876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e8fe2-3ea9-495a-b997-4650da2606df None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:31.385835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 100/202] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:31 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:31.392601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e8fe2-3ea9-495a-b997-4650da2606df None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:31.473325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92457e46-c24f-4dd8-ba95-38c8b6e0a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:31.474717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92457e46-c24f-4dd8-ba95-38c8b6e0a82f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:31.475224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92457e46-c24f-4dd8-ba95-38c8b6e0a82f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:31.475693 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92457e46-c24f-4dd8-ba95-38c8b6e0a82f None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:31.477450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92457e46-c24f-4dd8-ba95-38c8b6e0a82f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:31.477961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92457e46-c24f-4dd8-ba95-38c8b6e0a82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:31.479564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92457e46-c24f-4dd8-ba95-38c8b6e0a82f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:31.498026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 103/203] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:31.503061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92457e46-c24f-4dd8-ba95-38c8b6e0a82f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:31.503740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e8fe2-3ea9-495a-b997-4650da2606df None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:31.577497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc618-8d43-4856-955b-a06af9daf2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:31.578156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc618-8d43-4856-955b-a06af9daf2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:31.578443 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc618-8d43-4856-955b-a06af9daf2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:31.578715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54fc618-8d43-4856-955b-a06af9daf2f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:31.579559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fc618-8d43-4856-955b-a06af9daf2f4 None admin] RBAC: Adding query filter params (role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d, user.id=0a0891a7651c4a599e480d3d26b6b3fe) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:31.579864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fc618-8d43-4856-955b-a06af9daf2f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:31.581977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54fc618-8d43-4856-955b-a06af9daf2f4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:31.602684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 101/204] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:31 2022] GET /identity/v3/role_assignments?user.id=0a0891a7651c4a599e480d3d26b6b3fe&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=3e26988f292a493c8351b566b43239e2 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:31.637169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:31.658916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92457e46-c24f-4dd8-ba95-38c8b6e0a82f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:31.697424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec779b41-46e8-4373-a8d3-49ca1e31c3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:31.698758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec779b41-46e8-4373-a8d3-49ca1e31c3fb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:31.699251 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec779b41-46e8-4373-a8d3-49ca1e31c3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:31.699758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec779b41-46e8-4373-a8d3-49ca1e31c3fb None admin] PATH_INFO: `/v3/users/0ef14c81f3ee4b15bf034d2a3dbfd1cd` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:31.701416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec779b41-46e8-4373-a8d3-49ca1e31c3fb None admin] RBAC: Authorizing `identity:get_user(user_id=0ef14c81f3ee4b15bf034d2a3dbfd1cd)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:31.703349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec779b41-46e8-4373-a8d3-49ca1e31c3fb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:31.705748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 104/205] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:31 2022] GET /identity/v3/users/0ef14c81f3ee4b15bf034d2a3dbfd1cd => generated 289 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:31.711618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc618-8d43-4856-955b-a06af9daf2f4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:31.775674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:31.871243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54fc618-8d43-4856-955b-a06af9daf2f4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:31.918348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b41d2-84d1-4d7e-a0f6-978a865eb9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:31.919008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b41d2-84d1-4d7e-a0f6-978a865eb9be None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:31.919286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b41d2-84d1-4d7e-a0f6-978a865eb9be None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:31.919556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4b41d2-84d1-4d7e-a0f6-978a865eb9be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:32.002958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b41d2-84d1-4d7e-a0f6-978a865eb9be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:32.004425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4b41d2-84d1-4d7e-a0f6-978a865eb9be None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:32.051568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:32.130697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 102/206] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:32.137144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec779b41-46e8-4373-a8d3-49ca1e31c3fb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:32.270223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec779b41-46e8-4373-a8d3-49ca1e31c3fb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:32.320640 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e72b2-88ee-4b07-ba16-11fe37c82500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:32.321949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e72b2-88ee-4b07-ba16-11fe37c82500 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:32.322433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e72b2-88ee-4b07-ba16-11fe37c82500 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:32.322905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e72b2-88ee-4b07-ba16-11fe37c82500 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:32.324337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e72b2-88ee-4b07-ba16-11fe37c82500 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:32.326014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e72b2-88ee-4b07-ba16-11fe37c82500 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:32.328235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 105/207] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:32 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:32.333616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b41d2-84d1-4d7e-a0f6-978a865eb9be None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:32.475187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4b41d2-84d1-4d7e-a0f6-978a865eb9be None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:32.526152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08240c-444f-44c2-91f3-66acaabc3a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:32.526832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08240c-444f-44c2-91f3-66acaabc3a09 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:32.527068 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08240c-444f-44c2-91f3-66acaabc3a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:32.527355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08240c-444f-44c2-91f3-66acaabc3a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:32.528189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08240c-444f-44c2-91f3-66acaabc3a09 None admin] RBAC: Adding query filter params (role.id=546050dd0a7a4c989b85134c093336a9, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca, user.id=0ef14c81f3ee4b15bf034d2a3dbfd1cd) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:32.528674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08240c-444f-44c2-91f3-66acaabc3a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:32.530004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db08240c-444f-44c2-91f3-66acaabc3a09 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:32.537843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:32.541843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 103/208] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:32 2022] GET /identity/v3/role_assignments?user.id=0ef14c81f3ee4b15bf034d2a3dbfd1cd&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=546050dd0a7a4c989b85134c093336a9 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:33.300774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b399598-de79-4e6c-baf7-3066bf99a3e7 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:33.301280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b399598-de79-4e6c-baf7-3066bf99a3e7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:33.301357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b399598-de79-4e6c-baf7-3066bf99a3e7 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:33.302998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 106/209] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:33.309146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90151d1e-2287-4292-88c3-0916b356c3cb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:33.309683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90151d1e-2287-4292-88c3-0916b356c3cb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:33.310191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90151d1e-2287-4292-88c3-0916b356c3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:33.328241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-90151d1e-2287-4292-88c3-0916b356c3cb None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:33.329778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-90151d1e-2287-4292-88c3-0916b356c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:33.401054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 104/210] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:33.426121 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b399598-de79-4e6c-baf7-3066bf99a3e7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:33.455756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:33.542998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b399598-de79-4e6c-baf7-3066bf99a3e7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:33.580594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901c6943-baf6-4b90-b45f-4ec5bac628c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:33.581727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c6943-baf6-4b90-b45f-4ec5bac628c7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:33.582239 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c6943-baf6-4b90-b45f-4ec5bac628c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:33.582694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901c6943-baf6-4b90-b45f-4ec5bac628c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:33.584348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c6943-baf6-4b90-b45f-4ec5bac628c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:33.586315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901c6943-baf6-4b90-b45f-4ec5bac628c7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:33.588710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 107/211] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:33.594479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90151d1e-2287-4292-88c3-0916b356c3cb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:33.641254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00142d-4c9a-4871-aa68-030f3e819146 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:33.641549 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00142d-4c9a-4871-aa68-030f3e819146 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:33.641991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00142d-4c9a-4871-aa68-030f3e819146 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:33.643514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 108/212] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:33.649014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085e5d6-5e96-45ff-bc30-39504cf133a1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:33.649521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085e5d6-5e96-45ff-bc30-39504cf133a1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:33.649943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085e5d6-5e96-45ff-bc30-39504cf133a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:33.671889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0085e5d6-5e96-45ff-bc30-39504cf133a1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:33.674471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0085e5d6-5e96-45ff-bc30-39504cf133a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:33.709330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90151d1e-2287-4292-88c3-0916b356c3cb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:33.744514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:33.750401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c625986-a157-46f8-8dfe-51e03fc15088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:33.751372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625986-a157-46f8-8dfe-51e03fc15088 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:33.751880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625986-a157-46f8-8dfe-51e03fc15088 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:33.752358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c625986-a157-46f8-8dfe-51e03fc15088 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:33.753314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c625986-a157-46f8-8dfe-51e03fc15088 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:33.755195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c625986-a157-46f8-8dfe-51e03fc15088 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:33.763073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 109/213] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:33.785423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8574f-f6d1-41ad-9e11-1a88d6d93500 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:33.785978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8574f-f6d1-41ad-9e11-1a88d6d93500 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:33.786283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f8574f-f6d1-41ad-9e11-1a88d6d93500 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:33.787662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 110/214] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:33.788351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8574f-f6d1-41ad-9e11-1a88d6d93500 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:33.814291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:33.860806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 105/215] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:15:33 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:33.861997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58401b39-ee4f-4e88-96af-b2eab53ea4fe None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:33.862293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58401b39-ee4f-4e88-96af-b2eab53ea4fe None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:33.862568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58401b39-ee4f-4e88-96af-b2eab53ea4fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:33.889614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-58401b39-ee4f-4e88-96af-b2eab53ea4fe None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:33.891590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-58401b39-ee4f-4e88-96af-b2eab53ea4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:33.906967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f8574f-f6d1-41ad-9e11-1a88d6d93500 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:33.949493 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771294-6292-4807-b16c-87ff760450fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:33.950319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771294-6292-4807-b16c-87ff760450fb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:33.950598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771294-6292-4807-b16c-87ff760450fb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:33.950918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771294-6292-4807-b16c-87ff760450fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:33.964297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771294-6292-4807-b16c-87ff760450fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-79771294-6292-4807-b16c-87ff760450fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:33.972859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:33.973837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:33.974650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 111/216] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:33.981233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771294-6292-4807-b16c-87ff760450fb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.002737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 106/217] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:34.018649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58401b39-ee4f-4e88-96af-b2eab53ea4fe None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.090355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:34.116123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771294-6292-4807-b16c-87ff760450fb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:34.149442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58401b39-ee4f-4e88-96af-b2eab53ea4fe None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:34.153871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f2cf5-8092-4298-a198-4b29f9a04326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:34.154532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f2cf5-8092-4298-a198-4b29f9a04326 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.154797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f2cf5-8092-4298-a198-4b29f9a04326 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.155065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f2cf5-8092-4298-a198-4b29f9a04326 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.155814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f2cf5-8092-4298-a198-4b29f9a04326 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:34.156117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f2cf5-8092-4298-a198-4b29f9a04326 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:34.157622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f2cf5-8092-4298-a198-4b29f9a04326 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:34.167786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:34.171071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 112/218] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:34.171545 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478e49-bb2f-40b9-a9d2-85aceff2f9b7 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.171831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478e49-bb2f-40b9-a9d2-85aceff2f9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.172170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c478e49-bb2f-40b9-a9d2-85aceff2f9b7 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.173534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 113/219] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:34.176523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c478e49-bb2f-40b9-a9d2-85aceff2f9b7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.193482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dfc31-9091-4ea3-855a-1d5602378006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:34.194408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dfc31-9091-4ea3-855a-1d5602378006 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.194790 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dfc31-9091-4ea3-855a-1d5602378006 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.195632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dfc31-9091-4ea3-855a-1d5602378006 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.210002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791dfc31-9091-4ea3-855a-1d5602378006 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-791dfc31-9091-4ea3-855a-1d5602378006 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:34.222763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:34.223732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:34.224552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 107/220] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:34.225859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1018bc4-b67c-4748-aa72-794c0e8c26ef None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.225859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1018bc4-b67c-4748-aa72-794c0e8c26ef None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.226128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1018bc4-b67c-4748-aa72-794c0e8c26ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.253934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e1018bc4-b67c-4748-aa72-794c0e8c26ef None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:34.255457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e1018bc4-b67c-4748-aa72-794c0e8c26ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:34.314795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c478e49-bb2f-40b9-a9d2-85aceff2f9b7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:34.344046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 108/221] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:34.345247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1018bc4-b67c-4748-aa72-794c0e8c26ef None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.365859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfac8f-b26a-4823-9dbf-99201b322a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:34.367046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfac8f-b26a-4823-9dbf-99201b322a17 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.367460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfac8f-b26a-4823-9dbf-99201b322a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.367822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcfac8f-b26a-4823-9dbf-99201b322a17 None admin] PATH_INFO: `/v3/users/8281396f17364de08a34f07fa02b3600` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.393911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfac8f-b26a-4823-9dbf-99201b322a17 None admin] RBAC: Authorizing `identity:get_user(user_id=8281396f17364de08a34f07fa02b3600)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:34.395550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcfac8f-b26a-4823-9dbf-99201b322a17 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:34.397656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 114/222] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:34 2022] GET /identity/v3/users/8281396f17364de08a34f07fa02b3600 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:34.398505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfac8f-b26a-4823-9dbf-99201b322a17 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.401553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:34.469424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1018bc4-b67c-4748-aa72-794c0e8c26ef None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:34.480283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:34.512070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ec80a-942e-49f6-917c-821a97cde3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:34.513194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ec80a-942e-49f6-917c-821a97cde3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.513795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ec80a-942e-49f6-917c-821a97cde3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.514256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6ec80a-942e-49f6-917c-821a97cde3c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.515277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ec80a-942e-49f6-917c-821a97cde3c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:34.515771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ec80a-942e-49f6-917c-821a97cde3c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:34.517633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6ec80a-942e-49f6-917c-821a97cde3c2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:34.521244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcfac8f-b26a-4823-9dbf-99201b322a17 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:34.527406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 109/223] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:34.528531 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ec80a-942e-49f6-917c-821a97cde3c2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.566155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1d9da-6693-4ee3-9f5f-06a8eb37ce5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:34.566977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1d9da-6693-4ee3-9f5f-06a8eb37ce5d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.567495 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1d9da-6693-4ee3-9f5f-06a8eb37ce5d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.567790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d1d9da-6693-4ee3-9f5f-06a8eb37ce5d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.586897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d1d9da-6693-4ee3-9f5f-06a8eb37ce5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-33d1d9da-6693-4ee3-9f5f-06a8eb37ce5d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:34.602457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:34.603366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:34.604162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:34.607563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 115/224] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:34.612439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1d9da-6693-4ee3-9f5f-06a8eb37ce5d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.659471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6ec80a-942e-49f6-917c-821a97cde3c2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:34.699184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a951-193f-46ef-9daa-2f6b63dddcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:34.700889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a951-193f-46ef-9daa-2f6b63dddcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.701375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a951-193f-46ef-9daa-2f6b63dddcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.702083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:34.702522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8a951-193f-46ef-9daa-2f6b63dddcb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.747066 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d1d9da-6693-4ee3-9f5f-06a8eb37ce5d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:34.752300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:34.782515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2ebbd-0030-4f83-824e-107dcdfac460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:34.783390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2ebbd-0030-4f83-824e-107dcdfac460 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.783668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2ebbd-0030-4f83-824e-107dcdfac460 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.783937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2ebbd-0030-4f83-824e-107dcdfac460 None admin] PATH_INFO: `/v3/users/0a0891a7651c4a599e480d3d26b6b3fe` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.785232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2ebbd-0030-4f83-824e-107dcdfac460 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0891a7651c4a599e480d3d26b6b3fe)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:34.786643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2ebbd-0030-4f83-824e-107dcdfac460 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:34.788494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 116/225] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:34 2022] GET /identity/v3/users/0a0891a7651c4a599e480d3d26b6b3fe => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:34.789353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2ebbd-0030-4f83-824e-107dcdfac460 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.790623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8a951-193f-46ef-9daa-2f6b63dddcb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:34.792379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8a951-193f-46ef-9daa-2f6b63dddcb4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:34.896706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2ebbd-0030-4f83-824e-107dcdfac460 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:34.899056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 110/226] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:34.900229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a951-193f-46ef-9daa-2f6b63dddcb4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.932805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b631b19-7c74-4441-a57f-05e6f4ced021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:34.933429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b631b19-7c74-4441-a57f-05e6f4ced021 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:34.933712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b631b19-7c74-4441-a57f-05e6f4ced021 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:34.934114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b631b19-7c74-4441-a57f-05e6f4ced021 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:34.934917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b631b19-7c74-4441-a57f-05e6f4ced021 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:34.935223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b631b19-7c74-4441-a57f-05e6f4ced021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:34.936689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b631b19-7c74-4441-a57f-05e6f4ced021 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:34.949857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 117/227] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:34.949857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:34.949857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b631b19-7c74-4441-a57f-05e6f4ced021 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:34.982655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:35.026043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8a951-193f-46ef-9daa-2f6b63dddcb4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:35.063205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178355-6805-4809-ac98-0e802e8aeba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:35.064406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178355-6805-4809-ac98-0e802e8aeba3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:35.064864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178355-6805-4809-ac98-0e802e8aeba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:35.065280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1178355-6805-4809-ac98-0e802e8aeba3 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:35.066725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178355-6805-4809-ac98-0e802e8aeba3 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:35.068441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1178355-6805-4809-ac98-0e802e8aeba3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:35.070696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 111/228] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:34 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:35.071759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178355-6805-4809-ac98-0e802e8aeba3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:35.073638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b631b19-7c74-4441-a57f-05e6f4ced021 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:35.109169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f36291-d12e-423b-982f-41e49884a38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:35.110481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f36291-d12e-423b-982f-41e49884a38c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:35.110481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f36291-d12e-423b-982f-41e49884a38c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:35.110661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f36291-d12e-423b-982f-41e49884a38c None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:35.111777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f36291-d12e-423b-982f-41e49884a38c None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:35.113303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f36291-d12e-423b-982f-41e49884a38c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:35.115405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 118/229] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:34 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:35.116344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f36291-d12e-423b-982f-41e49884a38c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:35.178202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:35.184185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1178355-6805-4809-ac98-0e802e8aeba3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:35.223464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f36291-d12e-423b-982f-41e49884a38c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:35.225489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670ea70-e395-413c-9f43-b89cbebcee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:35.227228 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670ea70-e395-413c-9f43-b89cbebcee3b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:35.227712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670ea70-e395-413c-9f43-b89cbebcee3b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:35.228193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670ea70-e395-413c-9f43-b89cbebcee3b None admin] PATH_INFO: `/v3/users/0a0891a7651c4a599e480d3d26b6b3fe` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:35.229663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670ea70-e395-413c-9f43-b89cbebcee3b None admin] RBAC: Authorizing `identity:get_user(user_id=0a0891a7651c4a599e480d3d26b6b3fe)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:35.231326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670ea70-e395-413c-9f43-b89cbebcee3b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:35.233291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 112/230] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:35 2022] GET /identity/v3/users/0a0891a7651c4a599e480d3d26b6b3fe => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:35.234251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670ea70-e395-413c-9f43-b89cbebcee3b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:35.242408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:35.269062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3bf6-65f4-45ab-a4b4-dd468117193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:35.269993 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3bf6-65f4-45ab-a4b4-dd468117193b None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:35.270276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3bf6-65f4-45ab-a4b4-dd468117193b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:35.270773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9e3bf6-65f4-45ab-a4b4-dd468117193b None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/users/0a0891a7651c4a599e480d3d26b6b3fe/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:35.272738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e3bf6-65f4-45ab-a4b4-dd468117193b None admin] RBAC: Authorizing `identity:create_grant(project_id=3fb33448368d4b45a3d0f28261a78d5d, user_id=0a0891a7651c4a599e480d3d26b6b3fe, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:35.275042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9e3bf6-65f4-45ab-a4b4-dd468117193b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:35.362125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 119/231] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:15:35 2022] PUT /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/users/0a0891a7651c4a599e480d3d26b6b3fe/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:35.363008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3bf6-65f4-45ab-a4b4-dd468117193b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:35.416037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670ea70-e395-413c-9f43-b89cbebcee3b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:35.485311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e441911-4810-4118-b47d-a79ddc0c7f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:35.485992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441911-4810-4118-b47d-a79ddc0c7f95 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:35.486275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441911-4810-4118-b47d-a79ddc0c7f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:35.486551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e441911-4810-4118-b47d-a79ddc0c7f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:35.487409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e441911-4810-4118-b47d-a79ddc0c7f95 None admin] RBAC: Adding query filter params (role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d, user.id=8281396f17364de08a34f07fa02b3600) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:35.487720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e441911-4810-4118-b47d-a79ddc0c7f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:35.492268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e441911-4810-4118-b47d-a79ddc0c7f95 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:35.507117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 113/232] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:35 2022] GET /identity/v3/role_assignments?user.id=8281396f17364de08a34f07fa02b3600&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:35.528819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9e3bf6-65f4-45ab-a4b4-dd468117193b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:35.551308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:35.567500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf99ab-6c3e-4e23-bd27-a2b21b8c5c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:35.568390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf99ab-6c3e-4e23-bd27-a2b21b8c5c3a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:35.568700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf99ab-6c3e-4e23-bd27-a2b21b8c5c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:35.568977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf99ab-6c3e-4e23-bd27-a2b21b8c5c3a None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:35.570894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf99ab-6c3e-4e23-bd27-a2b21b8c5c3a None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:35.572390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf99ab-6c3e-4e23-bd27-a2b21b8c5c3a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:35.574579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 120/233] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:35 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:35.580867 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e441911-4810-4118-b47d-a79ddc0c7f95 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:35.679741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:35.722036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e441911-4810-4118-b47d-a79ddc0c7f95 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:35.774816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146aebe-8450-46f1-8561-c2f7517bc57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:35.775686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146aebe-8450-46f1-8561-c2f7517bc57e None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:35.775970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146aebe-8450-46f1-8561-c2f7517bc57e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:35.776240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146aebe-8450-46f1-8561-c2f7517bc57e None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/users/0a0891a7651c4a599e480d3d26b6b3fe/roles/3e26988f292a493c8351b566b43239e2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:35.780322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146aebe-8450-46f1-8561-c2f7517bc57e None admin] RBAC: Authorizing `identity:create_grant(project_id=3fb33448368d4b45a3d0f28261a78d5d, user_id=0a0891a7651c4a599e480d3d26b6b3fe, role_id=3e26988f292a493c8351b566b43239e2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:35.781848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146aebe-8450-46f1-8561-c2f7517bc57e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:35.878185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 114/234] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:15:35 2022] PUT /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/users/0a0891a7651c4a599e480d3d26b6b3fe/roles/3e26988f292a493c8351b566b43239e2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:36.462543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348d0f6-3f52-4faf-82cb-ac8c8054b30f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:36.463054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348d0f6-3f52-4faf-82cb-ac8c8054b30f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:36.463129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348d0f6-3f52-4faf-82cb-ac8c8054b30f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:36.464633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 121/235] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:36.470547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4d63a-1be7-4ce6-b321-521d2088ae7b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:36.470836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4d63a-1be7-4ce6-b321-521d2088ae7b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:36.471116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4d63a-1be7-4ce6-b321-521d2088ae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:36.488345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0cc4d63a-1be7-4ce6-b321-521d2088ae7b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:36.489553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0cc4d63a-1be7-4ce6-b321-521d2088ae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:36.572355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45dd8-3fe7-48d9-96ec-107b53592a46 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:36.572581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 115/236] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:36.572672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45dd8-3fe7-48d9-96ec-107b53592a46 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:36.572960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac45dd8-3fe7-48d9-96ec-107b53592a46 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:36.574345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 122/237] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:36.579472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590c67b-ed1c-4e80-862e-9deeb0d7a5d4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:36.579761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590c67b-ed1c-4e80-862e-9deeb0d7a5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:36.580039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5590c67b-ed1c-4e80-862e-9deeb0d7a5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:36.597052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5590c67b-ed1c-4e80-862e-9deeb0d7a5d4 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:36.598236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5590c67b-ed1c-4e80-862e-9deeb0d7a5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:36.598342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac45dd8-3fe7-48d9-96ec-107b53592a46 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:36.658524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:36.692146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 116/238] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:36.737503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590c67b-ed1c-4e80-862e-9deeb0d7a5d4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:36.796218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac45dd8-3fe7-48d9-96ec-107b53592a46 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:36.839736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c0db7-0f9b-4c11-8c8c-38629b499413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:36.842104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c0db7-0f9b-4c11-8c8c-38629b499413 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:36.844558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c0db7-0f9b-4c11-8c8c-38629b499413 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:36.845070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c0db7-0f9b-4c11-8c8c-38629b499413 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:36.868296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243c0db7-0f9b-4c11-8c8c-38629b499413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-243c0db7-0f9b-4c11-8c8c-38629b499413 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:36.884873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:36.885781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:36.886614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:36.896808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 123/239] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:36.906209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c0db7-0f9b-4c11-8c8c-38629b499413 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:36.958401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5590c67b-ed1c-4e80-862e-9deeb0d7a5d4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:36.965340 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:37.040329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c0db7-0f9b-4c11-8c8c-38629b499413 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:37.053743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856685b2-5903-4a87-a9af-58fd0538f778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:37.055200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856685b2-5903-4a87-a9af-58fd0538f778 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:37.055381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856685b2-5903-4a87-a9af-58fd0538f778 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:37.055639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856685b2-5903-4a87-a9af-58fd0538f778 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:37.057166 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856685b2-5903-4a87-a9af-58fd0538f778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:37.058886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856685b2-5903-4a87-a9af-58fd0538f778 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:37.060444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 117/240] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:37.069411 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856685b2-5903-4a87-a9af-58fd0538f778 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:37.082303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af68916-b4c1-4aab-8f07-6f99866a8e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:37.083402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af68916-b4c1-4aab-8f07-6f99866a8e5c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:37.083402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af68916-b4c1-4aab-8f07-6f99866a8e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:37.083651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af68916-b4c1-4aab-8f07-6f99866a8e5c None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:37.084437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af68916-b4c1-4aab-8f07-6f99866a8e5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:37.085031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af68916-b4c1-4aab-8f07-6f99866a8e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:37.087463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af68916-b4c1-4aab-8f07-6f99866a8e5c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:37.109408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 124/241] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:37.117935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af68916-b4c1-4aab-8f07-6f99866a8e5c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:37.139613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:37.187101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856685b2-5903-4a87-a9af-58fd0538f778 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:37.256312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58f625-1709-4e85-8391-6ffae073763c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:37.258047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58f625-1709-4e85-8391-6ffae073763c None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:37.259348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58f625-1709-4e85-8391-6ffae073763c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:37.259820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58f625-1709-4e85-8391-6ffae073763c None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:37.265427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58f625-1709-4e85-8391-6ffae073763c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:37.267266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58f625-1709-4e85-8391-6ffae073763c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:37.304598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af68916-b4c1-4aab-8f07-6f99866a8e5c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:37.316320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:37.340982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d1682-07d3-4e56-9fa6-057ce343c279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:37.342482 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1682-07d3-4e56-9fa6-057ce343c279 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:37.342955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1682-07d3-4e56-9fa6-057ce343c279 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:37.343445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51d1682-07d3-4e56-9fa6-057ce343c279 None admin] PATH_INFO: `/v3/users/3201ac92940f4f03b7f6653c67e2ecba` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:37.364465 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 118/242] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:15:37 2022] POST /identity/v3/users => generated 293 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:37.367810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d1682-07d3-4e56-9fa6-057ce343c279 None admin] RBAC: Authorizing `identity:get_user(user_id=3201ac92940f4f03b7f6653c67e2ecba)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:37.369689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51d1682-07d3-4e56-9fa6-057ce343c279 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:37.372278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 125/243] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:37 2022] GET /identity/v3/users/3201ac92940f4f03b7f6653c67e2ecba => generated 297 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:37.378387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58f625-1709-4e85-8391-6ffae073763c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:37.497805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58f625-1709-4e85-8391-6ffae073763c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:37.519745 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:37.552768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf34f6-b7a3-46d9-8c92-74cafe7c1535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:37.553447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf34f6-b7a3-46d9-8c92-74cafe7c1535 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:37.553727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf34f6-b7a3-46d9-8c92-74cafe7c1535 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:37.554005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddf34f6-b7a3-46d9-8c92-74cafe7c1535 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:37.651284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf34f6-b7a3-46d9-8c92-74cafe7c1535 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:37.653177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddf34f6-b7a3-46d9-8c92-74cafe7c1535 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:37.762326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 119/244] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:37.768721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d1682-07d3-4e56-9fa6-057ce343c279 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:37.880337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51d1682-07d3-4e56-9fa6-057ce343c279 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:37.919864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27927b36-8458-4631-8873-5b5800a3c2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:37.920781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27927b36-8458-4631-8873-5b5800a3c2dc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:37.921059 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27927b36-8458-4631-8873-5b5800a3c2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:37.921326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27927b36-8458-4631-8873-5b5800a3c2dc None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:37.922518 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27927b36-8458-4631-8873-5b5800a3c2dc None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:37.923977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27927b36-8458-4631-8873-5b5800a3c2dc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:37.926078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 126/245] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:37 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:37.932716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf34f6-b7a3-46d9-8c92-74cafe7c1535 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:37.944587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eadde6-553f-4a76-81b5-c69e2a1a8ef2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:37.944946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eadde6-553f-4a76-81b5-c69e2a1a8ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:37.946158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85eadde6-553f-4a76-81b5-c69e2a1a8ef2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:37.947400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 127/246] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:37.951458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:37.952681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23b0d-461b-4a7a-818d-1e7c2fa695f6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:37.953290 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23b0d-461b-4a7a-818d-1e7c2fa695f6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:37.953290 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e23b0d-461b-4a7a-818d-1e7c2fa695f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:37.970445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-54e23b0d-461b-4a7a-818d-1e7c2fa695f6 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:37.971619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-54e23b0d-461b-4a7a-818d-1e7c2fa695f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:38.004832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:38.048597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 128/247] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:38.065508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e23b0d-461b-4a7a-818d-1e7c2fa695f6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:38.067807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddf34f6-b7a3-46d9-8c92-74cafe7c1535 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:38.114643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92881-d65e-45f1-93bf-efc9b0a5ff5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:38.115808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92881-d65e-45f1-93bf-efc9b0a5ff5c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:38.116265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92881-d65e-45f1-93bf-efc9b0a5ff5c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:38.117352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e92881-d65e-45f1-93bf-efc9b0a5ff5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:38.118798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92881-d65e-45f1-93bf-efc9b0a5ff5c None admin] RBAC: Adding query filter params (role.id=546050dd0a7a4c989b85134c093336a9, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d, user.id=3201ac92940f4f03b7f6653c67e2ecba) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:38.119254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92881-d65e-45f1-93bf-efc9b0a5ff5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:38.121543 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e92881-d65e-45f1-93bf-efc9b0a5ff5c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:38.133267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 120/248] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:37 2022] GET /identity/v3/role_assignments?user.id=3201ac92940f4f03b7f6653c67e2ecba&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=546050dd0a7a4c989b85134c093336a9 => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:38.203588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e23b0d-461b-4a7a-818d-1e7c2fa695f6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:38.249179 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34763030-d58b-44b1-9f24-20b7c432833e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:38.250265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34763030-d58b-44b1-9f24-20b7c432833e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:38.250715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34763030-d58b-44b1-9f24-20b7c432833e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:38.251126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34763030-d58b-44b1-9f24-20b7c432833e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:38.264864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34763030-d58b-44b1-9f24-20b7c432833e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-34763030-d58b-44b1-9f24-20b7c432833e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:38.273323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:38.274635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:38.275629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:38.277753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 129/249] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:38.283738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92881-d65e-45f1-93bf-efc9b0a5ff5c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:38.369031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:38.398470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e92881-d65e-45f1-93bf-efc9b0a5ff5c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:38.408739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdaa7f-8a9f-4980-bce3-5643c5427cd3 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:38.409032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdaa7f-8a9f-4980-bce3-5643c5427cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:38.409294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cdaa7f-8a9f-4980-bce3-5643c5427cd3 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:38.410722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 130/250] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:38.416639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedad96-cb80-4051-b971-ea3a0e2b94c6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:38.416911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedad96-cb80-4051-b971-ea3a0e2b94c6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:38.417189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedad96-cb80-4051-b971-ea3a0e2b94c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:38.441349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fdedad96-cb80-4051-b971-ea3a0e2b94c6 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:38.442555 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fdedad96-cb80-4051-b971-ea3a0e2b94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:38.472960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12995c58-7202-43cb-8d7b-d9ffbdb21ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:38.473637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12995c58-7202-43cb-8d7b-d9ffbdb21ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:38.473915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12995c58-7202-43cb-8d7b-d9ffbdb21ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:38.474242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12995c58-7202-43cb-8d7b-d9ffbdb21ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:38.475107 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12995c58-7202-43cb-8d7b-d9ffbdb21ef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:38.475458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12995c58-7202-43cb-8d7b-d9ffbdb21ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:38.477215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12995c58-7202-43cb-8d7b-d9ffbdb21ef7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:38.478913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:38.492882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 121/251] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:38.501804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12995c58-7202-43cb-8d7b-d9ffbdb21ef7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:38.605965 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 131/252] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:38.650722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedad96-cb80-4051-b971-ea3a0e2b94c6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:38.666626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12995c58-7202-43cb-8d7b-d9ffbdb21ef7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:38.701422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd07a30-91cc-4c5c-bc57-d80524f9b009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:38.702680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd07a30-91cc-4c5c-bc57-d80524f9b009 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:38.703154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd07a30-91cc-4c5c-bc57-d80524f9b009 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:38.703626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd07a30-91cc-4c5c-bc57-d80524f9b009 None admin] PATH_INFO: `/v3/users/0a0891a7651c4a599e480d3d26b6b3fe` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:38.705126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd07a30-91cc-4c5c-bc57-d80524f9b009 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0891a7651c4a599e480d3d26b6b3fe)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:38.706792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd07a30-91cc-4c5c-bc57-d80524f9b009 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:38.708678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 122/253] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:38 2022] GET /identity/v3/users/0a0891a7651c4a599e480d3d26b6b3fe => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:38.717718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd07a30-91cc-4c5c-bc57-d80524f9b009 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:38.744852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:38.836071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdedad96-cb80-4051-b971-ea3a0e2b94c6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:38.877333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a716d-2a30-41c9-9df2-fba5d4119d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:38.878134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a716d-2a30-41c9-9df2-fba5d4119d60 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:38.878412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a716d-2a30-41c9-9df2-fba5d4119d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:38.878681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a716d-2a30-41c9-9df2-fba5d4119d60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:38.881351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd07a30-91cc-4c5c-bc57-d80524f9b009 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:38.893600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a716d-2a30-41c9-9df2-fba5d4119d60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-346a716d-2a30-41c9-9df2-fba5d4119d60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:38.901745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:38.902634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:38.903436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 132/254] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:38.904826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fa5c6-370b-449e-927d-69625af5b2f8 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:38.904826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fa5c6-370b-449e-927d-69625af5b2f8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:38.904826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5fa5c6-370b-449e-927d-69625af5b2f8 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:38.906111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 133/255] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:38.914048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fa5c6-370b-449e-927d-69625af5b2f8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:38.939104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:38.963436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c117-8fc5-416b-b442-008beba12294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:38.964250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c117-8fc5-416b-b442-008beba12294 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:38.967977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c117-8fc5-416b-b442-008beba12294 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:38.967977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2c117-8fc5-416b-b442-008beba12294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:39.037159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5fa5c6-370b-449e-927d-69625af5b2f8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:39.072320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2a6ae2-a9f3-496f-8fb6-ddb4083093d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:39.073028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a6ae2-a9f3-496f-8fb6-ddb4083093d9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:39.073358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a6ae2-a9f3-496f-8fb6-ddb4083093d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:39.073635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2a6ae2-a9f3-496f-8fb6-ddb4083093d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:39.074382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a6ae2-a9f3-496f-8fb6-ddb4083093d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:39.074740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a6ae2-a9f3-496f-8fb6-ddb4083093d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:39.076166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2a6ae2-a9f3-496f-8fb6-ddb4083093d9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:39.086695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 134/256] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:39.088192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1725e-ea1c-4e84-b7b5-3accee404248 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:39.088487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1725e-ea1c-4e84-b7b5-3accee404248 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:39.088775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1725e-ea1c-4e84-b7b5-3accee404248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:39.106042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6ba1725e-ea1c-4e84-b7b5-3accee404248 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:39.107267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6ba1725e-ea1c-4e84-b7b5-3accee404248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:39.157642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2c117-8fc5-416b-b442-008beba12294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:39.159064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2c117-8fc5-416b-b442-008beba12294 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:39.174097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:39.177182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 135/257] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:39.178037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1725e-ea1c-4e84-b7b5-3accee404248 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:39.202303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:39.360687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1725e-ea1c-4e84-b7b5-3accee404248 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:39.403107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fda33-c1ac-4a8e-bdef-32f85b0081e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:39.404007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fda33-c1ac-4a8e-bdef-32f85b0081e1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:39.404285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fda33-c1ac-4a8e-bdef-32f85b0081e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:39.404575 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267fda33-c1ac-4a8e-bdef-32f85b0081e1 None admin] PATH_INFO: `/v3/users/8281396f17364de08a34f07fa02b3600` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:39.409323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fda33-c1ac-4a8e-bdef-32f85b0081e1 None admin] RBAC: Authorizing `identity:get_user(user_id=8281396f17364de08a34f07fa02b3600)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:39.410730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267fda33-c1ac-4a8e-bdef-32f85b0081e1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:39.412385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 136/258] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:39 2022] GET /identity/v3/users/8281396f17364de08a34f07fa02b3600 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:39.413244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fda33-c1ac-4a8e-bdef-32f85b0081e1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:39.430928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 123/259] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:39.431816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c117-8fc5-416b-b442-008beba12294 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:39.559884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2c117-8fc5-416b-b442-008beba12294 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:39.568909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:39.599208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:39.627210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bad7b-583d-422c-b828-ec4cf336be73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:39.628084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bad7b-583d-422c-b828-ec4cf336be73 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:39.628369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bad7b-583d-422c-b828-ec4cf336be73 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:39.628666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bad7b-583d-422c-b828-ec4cf336be73 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:39.630837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bad7b-583d-422c-b828-ec4cf336be73 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:39.636797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0bad7b-583d-422c-b828-ec4cf336be73 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:39.641108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 124/260] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:39 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:39.641909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bad7b-583d-422c-b828-ec4cf336be73 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:39.650118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267fda33-c1ac-4a8e-bdef-32f85b0081e1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:39.696018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6987-b385-4826-bc1e-b50c5a7c08d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:39.697187 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6987-b385-4826-bc1e-b50c5a7c08d9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:39.697467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6987-b385-4826-bc1e-b50c5a7c08d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:39.697741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc6987-b385-4826-bc1e-b50c5a7c08d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:39.709125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecc6987-b385-4826-bc1e-b50c5a7c08d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-6ecc6987-b385-4826-bc1e-b50c5a7c08d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:39.724590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:39.725484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:39.727391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 137/261] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:39.728124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6987-b385-4826-bc1e-b50c5a7c08d9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:39.841588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc6987-b385-4826-bc1e-b50c5a7c08d9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:39.876443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d1959-d469-48b4-942d-f97d4ff0f1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:39.877356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d1959-d469-48b4-942d-f97d4ff0f1ec None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:39.877643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d1959-d469-48b4-942d-f97d4ff0f1ec None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:39.877920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d1959-d469-48b4-942d-f97d4ff0f1ec None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/users/8281396f17364de08a34f07fa02b3600/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:39.880082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d1959-d469-48b4-942d-f97d4ff0f1ec None admin] RBAC: Authorizing `identity:create_grant(project_id=3fb33448368d4b45a3d0f28261a78d5d, user_id=8281396f17364de08a34f07fa02b3600, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:39.881765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d1959-d469-48b4-942d-f97d4ff0f1ec None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:39.888793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:39.913023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0bad7b-583d-422c-b828-ec4cf336be73 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:39.945643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 138/262] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:15:39 2022] PUT /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/users/8281396f17364de08a34f07fa02b3600/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:39.946870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d1959-d469-48b4-942d-f97d4ff0f1ec None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:39.975358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45655c-5706-4a8d-af18-59fb2dfa6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:39.977743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45655c-5706-4a8d-af18-59fb2dfa6657 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:39.978470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45655c-5706-4a8d-af18-59fb2dfa6657 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:39.979348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da45655c-5706-4a8d-af18-59fb2dfa6657 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:39.982177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45655c-5706-4a8d-af18-59fb2dfa6657 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:39.984875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da45655c-5706-4a8d-af18-59fb2dfa6657 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:39.988190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 125/263] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:39 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:39.996020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45655c-5706-4a8d-af18-59fb2dfa6657 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:40.081781 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:40.169258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d1959-d469-48b4-942d-f97d4ff0f1ec None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:40.209589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da45655c-5706-4a8d-af18-59fb2dfa6657 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:40.228431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c696550-7c19-4bda-9862-75b3944d66b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:40.229423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c696550-7c19-4bda-9862-75b3944d66b9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:40.229730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c696550-7c19-4bda-9862-75b3944d66b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:40.230011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c696550-7c19-4bda-9862-75b3944d66b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:40.230800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c696550-7c19-4bda-9862-75b3944d66b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:40.231144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c696550-7c19-4bda-9862-75b3944d66b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:40.232645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c696550-7c19-4bda-9862-75b3944d66b9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:40.242480 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 139/264] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:40.247882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c696550-7c19-4bda-9862-75b3944d66b9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:40.305661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57fef0-5eac-40e0-95a2-50057ea985d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:40.306366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57fef0-5eac-40e0-95a2-50057ea985d6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:40.306658 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57fef0-5eac-40e0-95a2-50057ea985d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:40.306940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a57fef0-5eac-40e0-95a2-50057ea985d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:40.307800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57fef0-5eac-40e0-95a2-50057ea985d6 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d, user.id=0a0891a7651c4a599e480d3d26b6b3fe) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:40.308121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57fef0-5eac-40e0-95a2-50057ea985d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:40.309705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a57fef0-5eac-40e0-95a2-50057ea985d6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:40.314288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:40.320938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 126/265] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:39 2022] GET /identity/v3/role_assignments?user.id=0a0891a7651c4a599e480d3d26b6b3fe&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=7c09d078126441909df0a46212ffea63 => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:40.382790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c696550-7c19-4bda-9862-75b3944d66b9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:40.422178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e73c37-6735-4472-8440-fdc00c923ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:40.423081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73c37-6735-4472-8440-fdc00c923ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:40.423364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73c37-6735-4472-8440-fdc00c923ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:40.423639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e73c37-6735-4472-8440-fdc00c923ac9 None admin] PATH_INFO: `/v3/users/0a0891a7651c4a599e480d3d26b6b3fe` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:40.424933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e73c37-6735-4472-8440-fdc00c923ac9 None admin] RBAC: Authorizing `identity:get_user(user_id=0a0891a7651c4a599e480d3d26b6b3fe)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:40.426405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e73c37-6735-4472-8440-fdc00c923ac9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:40.428407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 140/266] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:40 2022] GET /identity/v3/users/0a0891a7651c4a599e480d3d26b6b3fe => generated 283 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:40.434408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57fef0-5eac-40e0-95a2-50057ea985d6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:40.548693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a57fef0-5eac-40e0-95a2-50057ea985d6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:40.559474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:40.611515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d30783-8a6b-4002-a4be-d1415ef86f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:40.612228 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30783-8a6b-4002-a4be-d1415ef86f13 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:40.612529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30783-8a6b-4002-a4be-d1415ef86f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:40.612809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d30783-8a6b-4002-a4be-d1415ef86f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:40.706560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d30783-8a6b-4002-a4be-d1415ef86f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:40.708062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d30783-8a6b-4002-a4be-d1415ef86f13 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:40.844143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 127/267] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:40.849518 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e73c37-6735-4472-8440-fdc00c923ac9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:40.872577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c39d2-4fa8-45a4-abbf-7c05aeacf814 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:40.872898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c39d2-4fa8-45a4-abbf-7c05aeacf814 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:40.873144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c39d2-4fa8-45a4-abbf-7c05aeacf814 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:40.874812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 128/268] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:40.879824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431c23-c3af-406f-9631-d9d0f9b99f67 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:40.880108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431c23-c3af-406f-9631-d9d0f9b99f67 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:40.880385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e431c23-c3af-406f-9631-d9d0f9b99f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:40.898864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:40.907663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3e431c23-c3af-406f-9631-d9d0f9b99f67 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:40.908896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3e431c23-c3af-406f-9631-d9d0f9b99f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:40.999968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 129/269] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:41.010367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ad8f-7a0a-41c1-a38e-d2fb41e0acce None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.010938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ad8f-7a0a-41c1-a38e-d2fb41e0acce None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.011405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a3ad8f-7a0a-41c1-a38e-d2fb41e0acce None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.013263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 130/270] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:41.020815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab24229-cefc-4b6d-a5fd-a5fe7cd74867 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.021373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab24229-cefc-4b6d-a5fd-a5fe7cd74867 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.021839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab24229-cefc-4b6d-a5fd-a5fe7cd74867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.044576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e73c37-6735-4472-8440-fdc00c923ac9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:41.049028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-dab24229-cefc-4b6d-a5fd-a5fe7cd74867 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:41.050468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dab24229-cefc-4b6d-a5fd-a5fe7cd74867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:41.072634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:41.083810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694018-e0cc-4506-b23e-7a6b6a7c8297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:41.090524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694018-e0cc-4506-b23e-7a6b6a7c8297 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.090524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694018-e0cc-4506-b23e-7a6b6a7c8297 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.090524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25694018-e0cc-4506-b23e-7a6b6a7c8297 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.090524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25694018-e0cc-4506-b23e-7a6b6a7c8297 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:41.090524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25694018-e0cc-4506-b23e-7a6b6a7c8297 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:41.090524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 141/271] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:40 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:41.091248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694018-e0cc-4506-b23e-7a6b6a7c8297 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:41.136866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 131/272] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:41.141651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab24229-cefc-4b6d-a5fd-a5fe7cd74867 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:41.232285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25694018-e0cc-4506-b23e-7a6b6a7c8297 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:41.240864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:41.272629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab24229-cefc-4b6d-a5fd-a5fe7cd74867 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:41.275689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0027ff-b422-4635-bf14-0cc1dd7a0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:41.276532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0027ff-b422-4635-bf14-0cc1dd7a0ddf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.276823 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0027ff-b422-4635-bf14-0cc1dd7a0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.277104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0027ff-b422-4635-bf14-0cc1dd7a0ddf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.278309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0027ff-b422-4635-bf14-0cc1dd7a0ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:41.279766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0027ff-b422-4635-bf14-0cc1dd7a0ddf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:41.281890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 142/273] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:41.282705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0027ff-b422-4635-bf14-0cc1dd7a0ddf None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:41.315469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed7a50-d5a6-4bea-b7cc-889d5380c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:41.316386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed7a50-d5a6-4bea-b7cc-889d5380c0aa None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.317095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed7a50-d5a6-4bea-b7cc-889d5380c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.317373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed7a50-d5a6-4bea-b7cc-889d5380c0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.318608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed7a50-d5a6-4bea-b7cc-889d5380c0aa None admin] RBAC: Adding query filter params (role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d, user.id=0a0891a7651c4a599e480d3d26b6b3fe) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:41.318967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed7a50-d5a6-4bea-b7cc-889d5380c0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:41.321520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed7a50-d5a6-4bea-b7cc-889d5380c0aa None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:41.330041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 132/274] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:41 2022] GET /identity/v3/role_assignments?user.id=0a0891a7651c4a599e480d3d26b6b3fe&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=3e26988f292a493c8351b566b43239e2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:41.330864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed7a50-d5a6-4bea-b7cc-889d5380c0aa None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:41.353644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:41.402111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0027ff-b422-4635-bf14-0cc1dd7a0ddf None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:41.446379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527f7bf-fb48-4b6f-bb7c-61cf72926f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:41.447218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527f7bf-fb48-4b6f-bb7c-61cf72926f46 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.447560 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527f7bf-fb48-4b6f-bb7c-61cf72926f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.447894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527f7bf-fb48-4b6f-bb7c-61cf72926f46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.460023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527f7bf-fb48-4b6f-bb7c-61cf72926f46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9527f7bf-fb48-4b6f-bb7c-61cf72926f46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:41.471476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:41.472679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:41.473691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:41.480503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 143/275] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:41.480503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0628ee-e14f-4562-8e05-b2297fcd4eb1 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.480503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0628ee-e14f-4562-8e05-b2297fcd4eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.480503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0628ee-e14f-4562-8e05-b2297fcd4eb1 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.481064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed7a50-d5a6-4bea-b7cc-889d5380c0aa None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:41.483829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 144/276] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:41.485133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0628ee-e14f-4562-8e05-b2297fcd4eb1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:41.520581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:41.530192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637fb74e-3d0a-4b7f-ae33-1cc2c3e542ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:41.530361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb74e-3d0a-4b7f-ae33-1cc2c3e542ef None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.530550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb74e-3d0a-4b7f-ae33-1cc2c3e542ef None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.530965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637fb74e-3d0a-4b7f-ae33-1cc2c3e542ef None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.532391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fb74e-3d0a-4b7f-ae33-1cc2c3e542ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:41.533081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637fb74e-3d0a-4b7f-ae33-1cc2c3e542ef None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:41.614481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0628ee-e14f-4562-8e05-b2297fcd4eb1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:41.641232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:41.648251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 133/277] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:15:41 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:41.649652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9551e-54ea-41ab-9f45-f9fed38e554a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.649945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9551e-54ea-41ab-9f45-f9fed38e554a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.650228 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f9551e-54ea-41ab-9f45-f9fed38e554a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.660681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe877b4-9f81-4f69-9d63-5b158d77457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:41.662959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe877b4-9f81-4f69-9d63-5b158d77457d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.663502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe877b4-9f81-4f69-9d63-5b158d77457d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.664035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe877b4-9f81-4f69-9d63-5b158d77457d None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.665217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe877b4-9f81-4f69-9d63-5b158d77457d None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:41.665768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe877b4-9f81-4f69-9d63-5b158d77457d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:41.667597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe877b4-9f81-4f69-9d63-5b158d77457d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:41.674525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-65f9551e-54ea-41ab-9f45-f9fed38e554a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:41.676308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-65f9551e-54ea-41ab-9f45-f9fed38e554a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:41.683739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 145/278] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:41.689500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe877b4-9f81-4f69-9d63-5b158d77457d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:41.765121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 134/279] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:41.789566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9551e-54ea-41ab-9f45-f9fed38e554a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:41.828118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe877b4-9f81-4f69-9d63-5b158d77457d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:41.873863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319282dc-c53f-40de-bb31-b2e57abb5a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:41.875185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319282dc-c53f-40de-bb31-b2e57abb5a36 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.875311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319282dc-c53f-40de-bb31-b2e57abb5a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.875618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319282dc-c53f-40de-bb31-b2e57abb5a36 None admin] PATH_INFO: `/v3/users/87ca896e7a9e4432844b64ed50b5cb12` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.890684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319282dc-c53f-40de-bb31-b2e57abb5a36 None admin] RBAC: Authorizing `identity:get_user(user_id=87ca896e7a9e4432844b64ed50b5cb12)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:41.892174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319282dc-c53f-40de-bb31-b2e57abb5a36 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:41.894046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 146/280] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:41 2022] GET /identity/v3/users/87ca896e7a9e4432844b64ed50b5cb12 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:41.901721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319282dc-c53f-40de-bb31-b2e57abb5a36 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:41.919093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f9551e-54ea-41ab-9f45-f9fed38e554a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:41.939394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:41.962140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:41.963451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd687eb8-d6b4-4c51-9de6-cf02b9d37e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:41.964351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd687eb8-d6b4-4c51-9de6-cf02b9d37e7b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:41.964752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd687eb8-d6b4-4c51-9de6-cf02b9d37e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:41.965118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd687eb8-d6b4-4c51-9de6-cf02b9d37e7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:41.978690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd687eb8-d6b4-4c51-9de6-cf02b9d37e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-cd687eb8-d6b4-4c51-9de6-cf02b9d37e7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:41.987045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:41.987932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:41.988751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 135/281] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:41.995269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd687eb8-d6b4-4c51-9de6-cf02b9d37e7b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:42.033103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319282dc-c53f-40de-bb31-b2e57abb5a36 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:42.074605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad91333-4326-444f-8ce2-a96565d52431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:42.075265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad91333-4326-444f-8ce2-a96565d52431 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:42.075545 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad91333-4326-444f-8ce2-a96565d52431 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:42.075816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad91333-4326-444f-8ce2-a96565d52431 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:42.077132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad91333-4326-444f-8ce2-a96565d52431 None admin] RBAC: Adding query filter params (role.id=511a27be33a74a7c996a7ca5261b55f6, user.id=87ca896e7a9e4432844b64ed50b5cb12, scope.system=all) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:42.077446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad91333-4326-444f-8ce2-a96565d52431 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:42.079556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad91333-4326-444f-8ce2-a96565d52431 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:42.088281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 147/282] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 07:15:41 2022] GET /identity/v3/role_assignments?user.id=87ca896e7a9e4432844b64ed50b5cb12&scope.system=all&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:42.121530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd687eb8-d6b4-4c51-9de6-cf02b9d37e7b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:42.162440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390ad3a-c786-44e5-b624-cf2356d3d4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:42.163129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390ad3a-c786-44e5-b624-cf2356d3d4df None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:42.163449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390ad3a-c786-44e5-b624-cf2356d3d4df None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:42.163764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390ad3a-c786-44e5-b624-cf2356d3d4df None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:42.164574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390ad3a-c786-44e5-b624-cf2356d3d4df None admin] RBAC: Adding query filter params (name=reader) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:42.164890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390ad3a-c786-44e5-b624-cf2356d3d4df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:42.166338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390ad3a-c786-44e5-b624-cf2356d3d4df None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:42.176730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 136/283] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:42.183287 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad91333-4326-444f-8ce2-a96565d52431 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:42.336538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad91333-4326-444f-8ce2-a96565d52431 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:42.348185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:42.379788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9fc58-0869-46f4-8cd3-29dded3473a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:42.380980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9fc58-0869-46f4-8cd3-29dded3473a8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:42.381363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9fc58-0869-46f4-8cd3-29dded3473a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:42.381711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9fc58-0869-46f4-8cd3-29dded3473a8 None admin] PATH_INFO: `/v3/users/3201ac92940f4f03b7f6653c67e2ecba` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:42.383101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9fc58-0869-46f4-8cd3-29dded3473a8 None admin] RBAC: Authorizing `identity:get_user(user_id=3201ac92940f4f03b7f6653c67e2ecba)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:42.384796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9fc58-0869-46f4-8cd3-29dded3473a8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:42.393602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390ad3a-c786-44e5-b624-cf2356d3d4df None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:42.399890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 148/284] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:42 2022] GET /identity/v3/users/3201ac92940f4f03b7f6653c67e2ecba => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:42.461080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:42.543878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390ad3a-c786-44e5-b624-cf2356d3d4df None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:42.580818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb8316-26f7-496a-ae5d-20e3454ad7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:42.582061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb8316-26f7-496a-ae5d-20e3454ad7be None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:42.582584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb8316-26f7-496a-ae5d-20e3454ad7be None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:42.583210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb8316-26f7-496a-ae5d-20e3454ad7be None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:42.586456 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb8316-26f7-496a-ae5d-20e3454ad7be None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:42.588144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb8316-26f7-496a-ae5d-20e3454ad7be None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:42.590285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 137/285] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:42 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:42.604595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9fc58-0869-46f4-8cd3-29dded3473a8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:42.791070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9fc58-0869-46f4-8cd3-29dded3473a8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:42.833730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafad94e-2973-4ae8-98f3-e41452a9d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:42.834629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafad94e-2973-4ae8-98f3-e41452a9d714 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:42.834913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafad94e-2973-4ae8-98f3-e41452a9d714 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:42.835190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafad94e-2973-4ae8-98f3-e41452a9d714 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/users/3201ac92940f4f03b7f6653c67e2ecba/roles/546050dd0a7a4c989b85134c093336a9` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:42.837835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafad94e-2973-4ae8-98f3-e41452a9d714 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fb33448368d4b45a3d0f28261a78d5d, user_id=3201ac92940f4f03b7f6653c67e2ecba, role_id=546050dd0a7a4c989b85134c093336a9)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:42.839296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafad94e-2973-4ae8-98f3-e41452a9d714 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:42.906697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 149/286] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:15:42 2022] PUT /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/users/3201ac92940f4f03b7f6653c67e2ecba/roles/546050dd0a7a4c989b85134c093336a9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:42.907776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe8580-1667-43c3-9e31-620426e1c97b None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:42.908071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe8580-1667-43c3-9e31-620426e1c97b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:42.908352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe8580-1667-43c3-9e31-620426e1c97b None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:42.909774 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 138/287] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:42.925956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747e378-e11a-4c9d-a5ef-b221f36e3f7c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:42.926240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747e378-e11a-4c9d-a5ef-b221f36e3f7c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:42.929523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8747e378-e11a-4c9d-a5ef-b221f36e3f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:42.956216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8747e378-e11a-4c9d-a5ef-b221f36e3f7c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:42.957507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8747e378-e11a-4c9d-a5ef-b221f36e3f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:43.012975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:43.078725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 150/288] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:43.126123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe8580-1667-43c3-9e31-620426e1c97b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:43.266697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe8580-1667-43c3-9e31-620426e1c97b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:43.273915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:43.311052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9660-93cd-4423-b128-27b13a73f5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:43.311920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9660-93cd-4423-b128-27b13a73f5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:43.312207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9660-93cd-4423-b128-27b13a73f5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:43.312498 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af9660-93cd-4423-b128-27b13a73f5b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:43.327090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af9660-93cd-4423-b128-27b13a73f5b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c4af9660-93cd-4423-b128-27b13a73f5b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:43.339246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:43.340115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:43.340953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 139/289] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:43.346527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747e378-e11a-4c9d-a5ef-b221f36e3f7c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:43.501403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8747e378-e11a-4c9d-a5ef-b221f36e3f7c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:43.555413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c882e-1f0e-4093-b550-f52c7a355f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:43.556115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c882e-1f0e-4093-b550-f52c7a355f2a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:43.556393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c882e-1f0e-4093-b550-f52c7a355f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:43.556698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536c882e-1f0e-4093-b550-f52c7a355f2a None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:43.557469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c882e-1f0e-4093-b550-f52c7a355f2a None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:43.557774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c882e-1f0e-4093-b550-f52c7a355f2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:43.559177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536c882e-1f0e-4093-b550-f52c7a355f2a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:43.573283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 151/290] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:43.578854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9660-93cd-4423-b128-27b13a73f5b2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:43.745425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af9660-93cd-4423-b128-27b13a73f5b2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:43.793653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b460424-1f42-4dc9-a609-c27aa9a7c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:43.794874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b460424-1f42-4dc9-a609-c27aa9a7c827 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:43.795374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b460424-1f42-4dc9-a609-c27aa9a7c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:43.795846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b460424-1f42-4dc9-a609-c27aa9a7c827 None admin] PATH_INFO: `/v3/users/8281396f17364de08a34f07fa02b3600` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:43.797409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b460424-1f42-4dc9-a609-c27aa9a7c827 None admin] RBAC: Authorizing `identity:get_user(user_id=8281396f17364de08a34f07fa02b3600)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:43.799053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b460424-1f42-4dc9-a609-c27aa9a7c827 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:43.801210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 140/291] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:43 2022] GET /identity/v3/users/8281396f17364de08a34f07fa02b3600 => generated 297 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:43.806770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c882e-1f0e-4093-b550-f52c7a355f2a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:43.850556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:43.964854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536c882e-1f0e-4093-b550-f52c7a355f2a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:44.009815 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858495a6-b8fa-4276-aa36-47c691fc8487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:44.010472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858495a6-b8fa-4276-aa36-47c691fc8487 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:44.010757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858495a6-b8fa-4276-aa36-47c691fc8487 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:44.011029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858495a6-b8fa-4276-aa36-47c691fc8487 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:44.099447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858495a6-b8fa-4276-aa36-47c691fc8487 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:44.101773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858495a6-b8fa-4276-aa36-47c691fc8487 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:44.138144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:44.235805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 152/292] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:44.237322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b460424-1f42-4dc9-a609-c27aa9a7c827 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:44.273802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:44.355367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b460424-1f42-4dc9-a609-c27aa9a7c827 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:44.393643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a48ac-55af-40cf-b3e6-ffeb97788875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:44.394517 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a48ac-55af-40cf-b3e6-ffeb97788875 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:44.394796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a48ac-55af-40cf-b3e6-ffeb97788875 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:44.395072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a48ac-55af-40cf-b3e6-ffeb97788875 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:44.396267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a48ac-55af-40cf-b3e6-ffeb97788875 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:44.398525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a48ac-55af-40cf-b3e6-ffeb97788875 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:44.400425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 141/293] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:44 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:44.406112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858495a6-b8fa-4276-aa36-47c691fc8487 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:44.567307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858495a6-b8fa-4276-aa36-47c691fc8487 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:44.614469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:44.626393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e03849-3749-4ad7-8fa4-baf7055d1e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:44.627063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e03849-3749-4ad7-8fa4-baf7055d1e30 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:44.627380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e03849-3749-4ad7-8fa4-baf7055d1e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:44.627620 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e03849-3749-4ad7-8fa4-baf7055d1e30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:44.628455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e03849-3749-4ad7-8fa4-baf7055d1e30 None admin] RBAC: Adding query filter params (role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d, user.id=8281396f17364de08a34f07fa02b3600) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:44.628790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e03849-3749-4ad7-8fa4-baf7055d1e30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:44.648397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e03849-3749-4ad7-8fa4-baf7055d1e30 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:44.648397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 153/294] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:44 2022] GET /identity/v3/role_assignments?user.id=8281396f17364de08a34f07fa02b3600&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:44.865596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725756-aaee-485e-94aa-da1294ae0b3d None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:44.865935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725756-aaee-485e-94aa-da1294ae0b3d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:44.866105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89725756-aaee-485e-94aa-da1294ae0b3d None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:44.867952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 142/295] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:44.873330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad870c4b-62b2-49bb-9aad-c96ad3bf2066 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:44.873624 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad870c4b-62b2-49bb-9aad-c96ad3bf2066 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:44.873907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad870c4b-62b2-49bb-9aad-c96ad3bf2066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:44.902535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ad870c4b-62b2-49bb-9aad-c96ad3bf2066 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:44.903748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ad870c4b-62b2-49bb-9aad-c96ad3bf2066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:44.968628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d19154-aa0b-4743-a2d8-5b3b6e25ff6d None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:44.968948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d19154-aa0b-4743-a2d8-5b3b6e25ff6d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:44.969188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d19154-aa0b-4743-a2d8-5b3b6e25ff6d None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:44.970606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 143/296] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:44.978740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a00ce-8913-4913-a0c4-83f1267df270 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:44.979068 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a00ce-8913-4913-a0c4-83f1267df270 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:44.979303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944a00ce-8913-4913-a0c4-83f1267df270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.001300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-944a00ce-8913-4913-a0c4-83f1267df270 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:45.002634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-944a00ce-8913-4913-a0c4-83f1267df270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:45.014315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 154/297] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:45.042260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad870c4b-62b2-49bb-9aad-c96ad3bf2066 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:45.086424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 144/298] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:45.117277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a00ce-8913-4913-a0c4-83f1267df270 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:45.160790 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:45.175298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad870c4b-62b2-49bb-9aad-c96ad3bf2066 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:45.196527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:45.209861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0abf6c4-e534-419b-9100-6d075543e379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:45.211333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abf6c4-e534-419b-9100-6d075543e379 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.211614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abf6c4-e534-419b-9100-6d075543e379 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.211890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0abf6c4-e534-419b-9100-6d075543e379 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.223046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0abf6c4-e534-419b-9100-6d075543e379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c0abf6c4-e534-419b-9100-6d075543e379 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:45.232638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:45.233531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:45.234323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 155/299] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:45.235234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e44996-6f7b-4e66-8e11-cf92be72292a None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.235982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e44996-6f7b-4e66-8e11-cf92be72292a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.236383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e44996-6f7b-4e66-8e11-cf92be72292a None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.238063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 156/300] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:45.239572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e44996-6f7b-4e66-8e11-cf92be72292a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:45.243082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944a00ce-8913-4913-a0c4-83f1267df270 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:45.338840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f6a4e-9b1b-41fe-acc7-4766b4ea6380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:45.339654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f6a4e-9b1b-41fe-acc7-4766b4ea6380 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.339940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f6a4e-9b1b-41fe-acc7-4766b4ea6380 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.340215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f6a4e-9b1b-41fe-acc7-4766b4ea6380 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.351738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f6a4e-9b1b-41fe-acc7-4766b4ea6380 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-950f6a4e-9b1b-41fe-acc7-4766b4ea6380 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:45.359584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:45.360504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:45.361322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 145/301] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:45.362287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6450c64-536e-40f4-957d-4549e7144d83 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.362375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6450c64-536e-40f4-957d-4549e7144d83 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.362604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6450c64-536e-40f4-957d-4549e7144d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.379104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c6450c64-536e-40f4-957d-4549e7144d83 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:45.380207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c6450c64-536e-40f4-957d-4549e7144d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:45.415959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e44996-6f7b-4e66-8e11-cf92be72292a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:45.447078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 146/302] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:45.448247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6450c64-536e-40f4-957d-4549e7144d83 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:45.462634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c3804-aa2c-4174-85ad-8f6653108a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:45.463315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c3804-aa2c-4174-85ad-8f6653108a30 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.463602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c3804-aa2c-4174-85ad-8f6653108a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.463881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c3804-aa2c-4174-85ad-8f6653108a30 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.464670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c3804-aa2c-4174-85ad-8f6653108a30 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:45.464977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c3804-aa2c-4174-85ad-8f6653108a30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:45.466482 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c3804-aa2c-4174-85ad-8f6653108a30 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:45.478157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 157/303] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:45.479065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c3804-aa2c-4174-85ad-8f6653108a30 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:45.480748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:45.527662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:45.574726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6450c64-536e-40f4-957d-4549e7144d83 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:45.590329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c3804-aa2c-4174-85ad-8f6653108a30 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:45.615690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd4ec6-b88b-482f-9642-adf8516957b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:45.616400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd4ec6-b88b-482f-9642-adf8516957b4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.616717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd4ec6-b88b-482f-9642-adf8516957b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.616993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abd4ec6-b88b-482f-9642-adf8516957b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.617744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd4ec6-b88b-482f-9642-adf8516957b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:45.618053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd4ec6-b88b-482f-9642-adf8516957b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:45.619467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abd4ec6-b88b-482f-9642-adf8516957b4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:45.627305 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcb800-165c-4e0b-b857-78842097ade7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:45.627966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 147/304] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:45.628604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd4ec6-b88b-482f-9642-adf8516957b4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:45.629289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcb800-165c-4e0b-b857-78842097ade7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.629778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcb800-165c-4e0b-b857-78842097ade7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.630270 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedcb800-165c-4e0b-b857-78842097ade7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.631966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcb800-165c-4e0b-b857-78842097ade7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:45.635308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedcb800-165c-4e0b-b857-78842097ade7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:45.636988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 158/305] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:45.641475 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcb800-165c-4e0b-b857-78842097ade7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:45.722354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:45.738461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abd4ec6-b88b-482f-9642-adf8516957b4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:45.738667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedcb800-165c-4e0b-b857-78842097ade7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:45.750330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:45.771313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805cf65b-b347-47bd-b9db-7002881a64dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:45.772189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf65b-b347-47bd-b9db-7002881a64dc None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.772495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf65b-b347-47bd-b9db-7002881a64dc None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.772819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805cf65b-b347-47bd-b9db-7002881a64dc None admin] PATH_INFO: `/v3/users/970881d160df4f91a331699119278609` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.772976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512a47f-0f03-40e1-a6f8-ebc47885e83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:45.773781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a47f-0f03-40e1-a6f8-ebc47885e83e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.774064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a47f-0f03-40e1-a6f8-ebc47885e83e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.774338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512a47f-0f03-40e1-a6f8-ebc47885e83e None admin] PATH_INFO: `/v3/users/87ca896e7a9e4432844b64ed50b5cb12` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.776431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512a47f-0f03-40e1-a6f8-ebc47885e83e None admin] RBAC: Authorizing `identity:get_user(user_id=87ca896e7a9e4432844b64ed50b5cb12)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:45.777926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512a47f-0f03-40e1-a6f8-ebc47885e83e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:45.779606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 159/306] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:45 2022] GET /identity/v3/users/87ca896e7a9e4432844b64ed50b5cb12 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:45.780356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512a47f-0f03-40e1-a6f8-ebc47885e83e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:45.786152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cf65b-b347-47bd-b9db-7002881a64dc None admin] RBAC: Authorizing `identity:get_user(user_id=970881d160df4f91a331699119278609)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:45.787604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805cf65b-b347-47bd-b9db-7002881a64dc None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:45.790064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 148/307] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:45 2022] GET /identity/v3/users/970881d160df4f91a331699119278609 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:45.790064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9eea4-bf07-4c29-ae4e-53339d088440 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.790064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9eea4-bf07-4c29-ae4e-53339d088440 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.790064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db9eea4-bf07-4c29-ae4e-53339d088440 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.790064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 149/308] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:45.790064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9eea4-bf07-4c29-ae4e-53339d088440 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:45.882402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512a47f-0f03-40e1-a6f8-ebc47885e83e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:45.892029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db9eea4-bf07-4c29-ae4e-53339d088440 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:45.916382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f5c30-5ab3-44db-8520-71811cc025e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:45.917071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5c30-5ab3-44db-8520-71811cc025e4 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.917355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5c30-5ab3-44db-8520-71811cc025e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.917629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f5c30-5ab3-44db-8520-71811cc025e4 None admin] PATH_INFO: `/v3/groups` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.918318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f5c30-5ab3-44db-8520-71811cc025e4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:45.919777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f5c30-5ab3-44db-8520-71811cc025e4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:45.925494 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6d33a-200f-4834-8721-1f44573c0c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:45.926352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6d33a-200f-4834-8721-1f44573c0c85 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:45.926624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6d33a-200f-4834-8721-1f44573c0c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:45.926894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6d33a-200f-4834-8721-1f44573c0c85 None admin] PATH_INFO: `/v3/system/users/87ca896e7a9e4432844b64ed50b5cb12/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:45.928341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6d33a-200f-4834-8721-1f44573c0c85 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=87ca896e7a9e4432844b64ed50b5cb12, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:45.930350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6d33a-200f-4834-8721-1f44573c0c85 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:46.023991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 160/309] 10.222.0.24 () {60 vars in 1134 bytes} [Wed May 25 07:15:45 2022] POST /identity/v3/groups => generated 229 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:46.024893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f5c30-5ab3-44db-8520-71811cc025e4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:46.061463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 150/310] 10.222.0.24 () {58 vars in 1334 bytes} [Wed May 25 07:15:45 2022] PUT /identity/v3/system/users/87ca896e7a9e4432844b64ed50b5cb12/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:46.062805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40b064-1ae2-458e-8619-dde39d8251a0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:46.063161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40b064-1ae2-458e-8619-dde39d8251a0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:46.063507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40b064-1ae2-458e-8619-dde39d8251a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:46.069133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:46.077196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:46.083521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2c40b064-1ae2-458e-8619-dde39d8251a0 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:46.084769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2c40b064-1ae2-458e-8619-dde39d8251a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:46.152317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f5c30-5ab3-44db-8520-71811cc025e4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:46.174634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 151/311] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:46.186014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad21b2-bf74-4d0c-92d8-d7b2d6783d1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:46.186689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad21b2-bf74-4d0c-92d8-d7b2d6783d1c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:46.186972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad21b2-bf74-4d0c-92d8-d7b2d6783d1c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:46.187247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad21b2-bf74-4d0c-92d8-d7b2d6783d1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:46.188096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad21b2-bf74-4d0c-92d8-d7b2d6783d1c None admin] RBAC: Adding query filter params (role.id=546050dd0a7a4c989b85134c093336a9, user.id=970881d160df4f91a331699119278609, scope.system=all) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:46.188415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad21b2-bf74-4d0c-92d8-d7b2d6783d1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:46.189977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad21b2-bf74-4d0c-92d8-d7b2d6783d1c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:46.200903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 161/312] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 07:15:46 2022] GET /identity/v3/role_assignments?user.id=970881d160df4f91a331699119278609&scope.system=all&role.id=546050dd0a7a4c989b85134c093336a9 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:46.203780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40b064-1ae2-458e-8619-dde39d8251a0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:46.341522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40b064-1ae2-458e-8619-dde39d8251a0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:46.379026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc082b75-728a-4596-8a84-39560ffe768b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:46.379840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc082b75-728a-4596-8a84-39560ffe768b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:46.380117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc082b75-728a-4596-8a84-39560ffe768b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:46.380390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc082b75-728a-4596-8a84-39560ffe768b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:46.384162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:46.392843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc082b75-728a-4596-8a84-39560ffe768b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-cc082b75-728a-4596-8a84-39560ffe768b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:46.401029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:46.402496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:46.403313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 152/313] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:46.408559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad21b2-bf74-4d0c-92d8-d7b2d6783d1c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:46.516699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad21b2-bf74-4d0c-92d8-d7b2d6783d1c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:46.518617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:46.558209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479942e7-47a9-4c6e-8be3-4192b40c53ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:46.558890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479942e7-47a9-4c6e-8be3-4192b40c53ce None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:46.559177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479942e7-47a9-4c6e-8be3-4192b40c53ce None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:46.559456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479942e7-47a9-4c6e-8be3-4192b40c53ce None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:46.560323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479942e7-47a9-4c6e-8be3-4192b40c53ce None admin] RBAC: Adding query filter params (name=reader) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:46.560550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479942e7-47a9-4c6e-8be3-4192b40c53ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:46.561957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479942e7-47a9-4c6e-8be3-4192b40c53ce None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:46.571987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 162/314] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:46.577503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc082b75-728a-4596-8a84-39560ffe768b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:46.692355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc082b75-728a-4596-8a84-39560ffe768b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:46.728085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d055d3-9a81-4b7d-8744-acb4fe82a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:46.728993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d055d3-9a81-4b7d-8744-acb4fe82a187 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:46.729272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d055d3-9a81-4b7d-8744-acb4fe82a187 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:46.729550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d055d3-9a81-4b7d-8744-acb4fe82a187 None admin] PATH_INFO: `/v3/users/3201ac92940f4f03b7f6653c67e2ecba` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:46.730753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d055d3-9a81-4b7d-8744-acb4fe82a187 None admin] RBAC: Authorizing `identity:get_user(user_id=3201ac92940f4f03b7f6653c67e2ecba)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:46.732207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d055d3-9a81-4b7d-8744-acb4fe82a187 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:46.734198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 153/315] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:46 2022] GET /identity/v3/users/3201ac92940f4f03b7f6653c67e2ecba => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:46.739415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479942e7-47a9-4c6e-8be3-4192b40c53ce None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:46.846205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479942e7-47a9-4c6e-8be3-4192b40c53ce None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:46.882155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657ab62-b359-465f-8c8d-6596f28b73ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:46.883167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657ab62-b359-465f-8c8d-6596f28b73ed None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:46.883461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657ab62-b359-465f-8c8d-6596f28b73ed None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:46.883745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8657ab62-b359-465f-8c8d-6596f28b73ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:46.917067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:46.957245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657ab62-b359-465f-8c8d-6596f28b73ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:46.958636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8657ab62-b359-465f-8c8d-6596f28b73ed None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:47.070942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 163/316] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:47.075916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d055d3-9a81-4b7d-8744-acb4fe82a187 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:47.138748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:47.180046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d055d3-9a81-4b7d-8744-acb4fe82a187 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:47.222883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11e4f3-e9bb-4c22-baab-1b17153afe17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:47.223964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11e4f3-e9bb-4c22-baab-1b17153afe17 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:47.224391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11e4f3-e9bb-4c22-baab-1b17153afe17 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:47.224831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11e4f3-e9bb-4c22-baab-1b17153afe17 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:47.226424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11e4f3-e9bb-4c22-baab-1b17153afe17 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:47.228051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11e4f3-e9bb-4c22-baab-1b17153afe17 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:47.237192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657ab62-b359-465f-8c8d-6596f28b73ed None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:47.248009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 154/317] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:47 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:47.305638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:47.346811 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8657ab62-b359-465f-8c8d-6596f28b73ed None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:47.383946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdf1a04-8b8c-4153-9198-cd5728e59a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:47.384920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1a04-8b8c-4153-9198-cd5728e59a30 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:47.385347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1a04-8b8c-4153-9198-cd5728e59a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:47.385767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdf1a04-8b8c-4153-9198-cd5728e59a30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:47.386745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf1a04-8b8c-4153-9198-cd5728e59a30 None admin] RBAC: Adding query filter params (role.id=546050dd0a7a4c989b85134c093336a9, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d, user.id=3201ac92940f4f03b7f6653c67e2ecba) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:47.387219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf1a04-8b8c-4153-9198-cd5728e59a30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:47.388845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdf1a04-8b8c-4153-9198-cd5728e59a30 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:47.395836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 164/318] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:15:47 2022] GET /identity/v3/role_assignments?user.id=3201ac92940f4f03b7f6653c67e2ecba&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=546050dd0a7a4c989b85134c093336a9 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:48.402385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886da2-071d-457e-aaa3-937a6ba89b46 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.402932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886da2-071d-457e-aaa3-937a6ba89b46 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.402932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25886da2-071d-457e-aaa3-937a6ba89b46 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.404631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 155/319] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:48.409688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37f19-2bda-4083-80d6-00b1119dfc91 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.410064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37f19-2bda-4083-80d6-00b1119dfc91 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.410248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e37f19-2bda-4083-80d6-00b1119dfc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.428406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a6e37f19-2bda-4083-80d6-00b1119dfc91 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:48.430319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a6e37f19-2bda-4083-80d6-00b1119dfc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:48.447093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e1ac4-6725-4ec3-8aed-70c8f10a5fe0 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.447380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e1ac4-6725-4ec3-8aed-70c8f10a5fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.447654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e1ac4-6725-4ec3-8aed-70c8f10a5fe0 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.449057 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 156/320] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:48.454442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a210-f0e2-4ff8-9d1f-eec1b567c3a4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.454900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a210-f0e2-4ff8-9d1f-eec1b567c3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.455187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00a210-f0e2-4ff8-9d1f-eec1b567c3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.477789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ab00a210-f0e2-4ff8-9d1f-eec1b567c3a4 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:48.479053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ab00a210-f0e2-4ff8-9d1f-eec1b567c3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:48.502185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 165/321] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:48.525373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37f19-2bda-4083-80d6-00b1119dfc91 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:48.550127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 157/322] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:48.551544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c8d79-7df8-447b-9374-9777633faad5 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.551850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c8d79-7df8-447b-9374-9777633faad5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.552224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490c8d79-7df8-447b-9374-9777633faad5 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.553446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 158/323] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:48.562633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe8691-d974-43f4-b850-1d9c574223fa None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.563091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe8691-d974-43f4-b850-1d9c574223fa None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.563535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe8691-d974-43f4-b850-1d9c574223fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.580219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d1fe8691-d974-43f4-b850-1d9c574223fa None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:48.583587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d1fe8691-d974-43f4-b850-1d9c574223fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:48.585694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:48.628102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e37f19-2bda-4083-80d6-00b1119dfc91 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:48.642093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:48.652267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 159/324] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:48.656856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe8691-d974-43f4-b850-1d9c574223fa None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:48.665209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f8d32-8ccb-4249-a245-f8e70e9a46f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:48.666001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f8d32-8ccb-4249-a245-f8e70e9a46f9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.666279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f8d32-8ccb-4249-a245-f8e70e9a46f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.666551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f8d32-8ccb-4249-a245-f8e70e9a46f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.677610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f8d32-8ccb-4249-a245-f8e70e9a46f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0b5f8d32-8ccb-4249-a245-f8e70e9a46f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:48.685478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:48.686422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:48.687205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 166/325] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:48.689132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f8d32-8ccb-4249-a245-f8e70e9a46f9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:48.753828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fe8691-d974-43f4-b850-1d9c574223fa None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:48.786486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418b10-a52b-454e-8876-116e44496372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:48.787265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418b10-a52b-454e-8876-116e44496372 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.787544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418b10-a52b-454e-8876-116e44496372 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.787727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f8d32-8ccb-4249-a245-f8e70e9a46f9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:48.787822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2418b10-a52b-454e-8876-116e44496372 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.789855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2418b10-a52b-454e-8876-116e44496372 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:48.791303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2418b10-a52b-454e-8876-116e44496372 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:48.792934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 160/326] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:48.793683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418b10-a52b-454e-8876-116e44496372 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:48.808630 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:48.824618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d560502-ab80-4314-8c1e-37c17f7d8c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:48.825406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d560502-ab80-4314-8c1e-37c17f7d8c36 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.825688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d560502-ab80-4314-8c1e-37c17f7d8c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.825960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d560502-ab80-4314-8c1e-37c17f7d8c36 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.837364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d560502-ab80-4314-8c1e-37c17f7d8c36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-6d560502-ab80-4314-8c1e-37c17f7d8c36 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:48.845917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:48.846788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:48.847570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 167/327] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:48.848220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d560502-ab80-4314-8c1e-37c17f7d8c36 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:48.855459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:48.894115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2418b10-a52b-454e-8876-116e44496372 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:48.928223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356c8b0-ed9b-4a6e-a60e-d7d25d69392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:48.929381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356c8b0-ed9b-4a6e-a60e-d7d25d69392d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.929805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356c8b0-ed9b-4a6e-a60e-d7d25d69392d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.930077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2356c8b0-ed9b-4a6e-a60e-d7d25d69392d None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.930822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356c8b0-ed9b-4a6e-a60e-d7d25d69392d None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:48.931123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356c8b0-ed9b-4a6e-a60e-d7d25d69392d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:48.932524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2356c8b0-ed9b-4a6e-a60e-d7d25d69392d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:48.940372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 161/328] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:48.941175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356c8b0-ed9b-4a6e-a60e-d7d25d69392d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:48.952167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d560502-ab80-4314-8c1e-37c17f7d8c36 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:48.987944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff62d1f-d936-44a5-bdad-89c1a7009613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:48.988649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff62d1f-d936-44a5-bdad-89c1a7009613 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:48.988930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff62d1f-d936-44a5-bdad-89c1a7009613 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:48.989205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff62d1f-d936-44a5-bdad-89c1a7009613 None admin] PATH_INFO: `/v3/groups` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:48.989892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff62d1f-d936-44a5-bdad-89c1a7009613 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:48.991944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff62d1f-d936-44a5-bdad-89c1a7009613 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:49.039065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2356c8b0-ed9b-4a6e-a60e-d7d25d69392d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:49.060312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:49.071792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4417b-3b6b-4e74-99fc-ace9fc820448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:49.072440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4417b-3b6b-4e74-99fc-ace9fc820448 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:49.072752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4417b-3b6b-4e74-99fc-ace9fc820448 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:49.073026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4417b-3b6b-4e74-99fc-ace9fc820448 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:49.073761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4417b-3b6b-4e74-99fc-ace9fc820448 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:49.074063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4417b-3b6b-4e74-99fc-ace9fc820448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:49.075499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4417b-3b6b-4e74-99fc-ace9fc820448 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:49.081110 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 168/329] 10.222.0.24 () {60 vars in 1134 bytes} [Wed May 25 07:15:48 2022] POST /identity/v3/groups => generated 226 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:15:49.081984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff62d1f-d936-44a5-bdad-89c1a7009613 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:49.094588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 162/330] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:49.100571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4417b-3b6b-4e74-99fc-ace9fc820448 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:49.133709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:49.199873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff62d1f-d936-44a5-bdad-89c1a7009613 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:49.212516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4417b-3b6b-4e74-99fc-ace9fc820448 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:49.239479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07d99-8554-4670-91cd-6926d93eb008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:49.240715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07d99-8554-4670-91cd-6926d93eb008 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:49.241001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07d99-8554-4670-91cd-6926d93eb008 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:49.241279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b07d99-8554-4670-91cd-6926d93eb008 None admin] PATH_INFO: `/v3/users/87ca896e7a9e4432844b64ed50b5cb12` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:49.242714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b07d99-8554-4670-91cd-6926d93eb008 None admin] RBAC: Authorizing `identity:get_user(user_id=87ca896e7a9e4432844b64ed50b5cb12)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:49.244201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b07d99-8554-4670-91cd-6926d93eb008 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:49.245942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 169/331] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:49 2022] GET /identity/v3/users/87ca896e7a9e4432844b64ed50b5cb12 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:49.251814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07d99-8554-4670-91cd-6926d93eb008 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:49.252114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b79afa-9b30-4c79-bc20-7026bece0c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:49.254172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b79afa-9b30-4c79-bc20-7026bece0c6c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:49.254172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b79afa-9b30-4c79-bc20-7026bece0c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:49.254172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b79afa-9b30-4c79-bc20-7026bece0c6c None admin] PATH_INFO: `/v3/users/970881d160df4f91a331699119278609` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:49.255486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b79afa-9b30-4c79-bc20-7026bece0c6c None admin] RBAC: Authorizing `identity:get_user(user_id=970881d160df4f91a331699119278609)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:49.258514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b79afa-9b30-4c79-bc20-7026bece0c6c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:49.260497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 163/332] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:49 2022] GET /identity/v3/users/970881d160df4f91a331699119278609 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:49.265933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b79afa-9b30-4c79-bc20-7026bece0c6c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:49.325739 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:49.379501 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b79afa-9b30-4c79-bc20-7026bece0c6c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:49.380794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b07d99-8554-4670-91cd-6926d93eb008 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:49.392843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:49.422711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4625510-2f13-446d-b525-b0d15260c879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:49.423584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4625510-2f13-446d-b525-b0d15260c879 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:49.423867 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4625510-2f13-446d-b525-b0d15260c879 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:49.424144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4625510-2f13-446d-b525-b0d15260c879 None admin] PATH_INFO: `/v3/system/users/970881d160df4f91a331699119278609/roles/546050dd0a7a4c989b85134c093336a9` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:49.425782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4625510-2f13-446d-b525-b0d15260c879 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=970881d160df4f91a331699119278609, role_id=546050dd0a7a4c989b85134c093336a9)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:49.426623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d2be22-2637-47c9-a689-0e8aae04301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:49.427197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4625510-2f13-446d-b525-b0d15260c879 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:49.427293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2be22-2637-47c9-a689-0e8aae04301f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:49.427548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2be22-2637-47c9-a689-0e8aae04301f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:49.427821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d2be22-2637-47c9-a689-0e8aae04301f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:49.429096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2be22-2637-47c9-a689-0e8aae04301f None admin] RBAC: Adding query filter params (role.id=511a27be33a74a7c996a7ca5261b55f6, user.id=87ca896e7a9e4432844b64ed50b5cb12, scope.system=all) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:49.429410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2be22-2637-47c9-a689-0e8aae04301f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:49.431314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d2be22-2637-47c9-a689-0e8aae04301f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:49.446348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 170/333] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 07:15:49 2022] GET /identity/v3/role_assignments?user.id=87ca896e7a9e4432844b64ed50b5cb12&scope.system=all&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 510 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:15:49.478630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 164/334] 10.222.0.24 () {58 vars in 1334 bytes} [Wed May 25 07:15:49 2022] PUT /identity/v3/system/users/970881d160df4f91a331699119278609/roles/546050dd0a7a4c989b85134c093336a9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:15:52.003607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cb0a1-6a2b-42ba-8169-52e052bfe0e6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:52.004149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cb0a1-6a2b-42ba-8169-52e052bfe0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:52.004149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70cb0a1-6a2b-42ba-8169-52e052bfe0e6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:52.005843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 171/335] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:52.011256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee4dc6-9693-421f-bd5f-ba6bfaed0e42 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:52.012104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee4dc6-9693-421f-bd5f-ba6bfaed0e42 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:52.012546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcee4dc6-9693-421f-bd5f-ba6bfaed0e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:52.025799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e12f9f-70b0-4dbf-ab8c-4afc96a988dc None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:52.026306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e12f9f-70b0-4dbf-ab8c-4afc96a988dc None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:52.026753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e12f9f-70b0-4dbf-ab8c-4afc96a988dc None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:52.028278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 172/336] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:52 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:52.033797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbb7ce-08bb-4ae7-befb-cca4c0eed3d8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:52.034270 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbb7ce-08bb-4ae7-befb-cca4c0eed3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:52.034687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adbb7ce-08bb-4ae7-befb-cca4c0eed3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:52.041330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bcee4dc6-9693-421f-bd5f-ba6bfaed0e42 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:52.043217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bcee4dc6-9693-421f-bd5f-ba6bfaed0e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:52.074797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8adbb7ce-08bb-4ae7-befb-cca4c0eed3d8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:52.076299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8adbb7ce-08bb-4ae7-befb-cca4c0eed3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:52.201954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 165/337] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:52.227967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 173/338] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:52.243201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee4dc6-9693-421f-bd5f-ba6bfaed0e42 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:52.266728 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbb7ce-08bb-4ae7-befb-cca4c0eed3d8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:52.345416 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:52.440467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:52.445018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adbb7ce-08bb-4ae7-befb-cca4c0eed3d8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:52.478660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcee4dc6-9693-421f-bd5f-ba6bfaed0e42 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:52.494565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029eeb72-148f-4102-bc9c-1a0fc28c1db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:52.495375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029eeb72-148f-4102-bc9c-1a0fc28c1db6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:52.495658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029eeb72-148f-4102-bc9c-1a0fc28c1db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:52.495930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029eeb72-148f-4102-bc9c-1a0fc28c1db6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:52.521521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029eeb72-148f-4102-bc9c-1a0fc28c1db6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-029eeb72-148f-4102-bc9c-1a0fc28c1db6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:52.530610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:52.532697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:52.533725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:52.536265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 174/339] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:52.539401 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d04b4-e42d-459a-aa32-ce20e6eef927 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:52.539851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d04b4-e42d-459a-aa32-ce20e6eef927 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:52.540288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d04b4-e42d-459a-aa32-ce20e6eef927 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:52.541951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 175/340] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:52.542829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d04b4-e42d-459a-aa32-ce20e6eef927 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:52.562508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03baa90c-fbb4-4df4-9715-a8f320fc42e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:52.563656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baa90c-fbb4-4df4-9715-a8f320fc42e2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:52.564114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baa90c-fbb4-4df4-9715-a8f320fc42e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:52.564590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03baa90c-fbb4-4df4-9715-a8f320fc42e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:52.589187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03baa90c-fbb4-4df4-9715-a8f320fc42e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-03baa90c-fbb4-4df4-9715-a8f320fc42e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:52.598316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:52.599238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:52.600040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:52.611813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 166/341] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:52.613346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbc57-1f95-4015-8af2-41862e11155b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:52.613642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbc57-1f95-4015-8af2-41862e11155b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:52.613920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8cbc57-1f95-4015-8af2-41862e11155b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:52.656566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bc8cbc57-1f95-4015-8af2-41862e11155b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:52.657776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bc8cbc57-1f95-4015-8af2-41862e11155b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:52.760072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d04b4-e42d-459a-aa32-ce20e6eef927 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:52.808200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 167/342] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:52.809567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbc57-1f95-4015-8af2-41862e11155b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:52.826234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeef28-e9dd-4581-b5f9-b10cbf0a7930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:52.827148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeef28-e9dd-4581-b5f9-b10cbf0a7930 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:52.827735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeef28-e9dd-4581-b5f9-b10cbf0a7930 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:52.828158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadeef28-e9dd-4581-b5f9-b10cbf0a7930 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:52.829467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeef28-e9dd-4581-b5f9-b10cbf0a7930 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:52.830211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeef28-e9dd-4581-b5f9-b10cbf0a7930 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:52.831896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadeef28-e9dd-4581-b5f9-b10cbf0a7930 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:52.854879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 176/343] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:52.855738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeef28-e9dd-4581-b5f9-b10cbf0a7930 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:52.868043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:52.907584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:52.978344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8cbc57-1f95-4015-8af2-41862e11155b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:53.021124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94cf0b-f845-4fb2-9f25-57d29456df7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:53.022814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94cf0b-f845-4fb2-9f25-57d29456df7f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.023529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94cf0b-f845-4fb2-9f25-57d29456df7f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.024174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94cf0b-f845-4fb2-9f25-57d29456df7f None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.025185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94cf0b-f845-4fb2-9f25-57d29456df7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:53.025728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94cf0b-f845-4fb2-9f25-57d29456df7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:53.027415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94cf0b-f845-4fb2-9f25-57d29456df7f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:53.045467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 168/344] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:53.047478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94cf0b-f845-4fb2-9f25-57d29456df7f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:53.083407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadeef28-e9dd-4581-b5f9-b10cbf0a7930 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:53.121972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c5805-670c-4e92-86cb-c79be2d8d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:53.123286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c5805-670c-4e92-86cb-c79be2d8d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.123980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c5805-670c-4e92-86cb-c79be2d8d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.124421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c5805-670c-4e92-86cb-c79be2d8d5a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.136465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c5805-670c-4e92-86cb-c79be2d8d5a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7c1c5805-670c-4e92-86cb-c79be2d8d5a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:53.144318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:53.145298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:53.146181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 177/345] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:53.146878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c5805-670c-4e92-86cb-c79be2d8d5a7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:53.164857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:53.171650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94cf0b-f845-4fb2-9f25-57d29456df7f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:53.216041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc3730-da01-40b8-b230-5eea78f28a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:53.217374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc3730-da01-40b8-b230-5eea78f28a0a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.217853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc3730-da01-40b8-b230-5eea78f28a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.218348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc3730-da01-40b8-b230-5eea78f28a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.243835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:53.270876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c5805-670c-4e92-86cb-c79be2d8d5a7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:53.307339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc3730-da01-40b8-b230-5eea78f28a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:53.308978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc3730-da01-40b8-b230-5eea78f28a0a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:53.320782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87597294-73e6-4672-b4ec-16929ecfc166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:53.322062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87597294-73e6-4672-b4ec-16929ecfc166 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.322343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87597294-73e6-4672-b4ec-16929ecfc166 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.322617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87597294-73e6-4672-b4ec-16929ecfc166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.412296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87597294-73e6-4672-b4ec-16929ecfc166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:53.414197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87597294-73e6-4672-b4ec-16929ecfc166 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:53.446928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:53.453332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 169/346] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:53.455017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f3c94-0122-43b0-ad39-f83f55c8f720 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.455319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f3c94-0122-43b0-ad39-f83f55c8f720 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.455595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f3c94-0122-43b0-ad39-f83f55c8f720 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.457143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 170/347] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:53.459321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643c862-58d7-4f73-94df-379c41260672 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.464683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643c862-58d7-4f73-94df-379c41260672 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.464683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643c862-58d7-4f73-94df-379c41260672 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.464683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 171/348] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:53.464683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643c862-58d7-4f73-94df-379c41260672 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:53.521177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:53.548615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 178/349] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:53.551029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87597294-73e6-4672-b4ec-16929ecfc166 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:53.606143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643c862-58d7-4f73-94df-379c41260672 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:53.652062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cde1ca9-fcd8-4a58-a8b7-17d5b6266080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:53.652807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde1ca9-fcd8-4a58-a8b7-17d5b6266080 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.653095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde1ca9-fcd8-4a58-a8b7-17d5b6266080 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.653375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde1ca9-fcd8-4a58-a8b7-17d5b6266080 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.654164 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde1ca9-fcd8-4a58-a8b7-17d5b6266080 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:53.654480 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde1ca9-fcd8-4a58-a8b7-17d5b6266080 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:53.655957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cde1ca9-fcd8-4a58-a8b7-17d5b6266080 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:53.667877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 172/350] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:53.669879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b935d2b-080c-43ea-9881-7076d88b3ebf None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.670176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b935d2b-080c-43ea-9881-7076d88b3ebf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.670477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b935d2b-080c-43ea-9881-7076d88b3ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.689106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87597294-73e6-4672-b4ec-16929ecfc166 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:53.693527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7b935d2b-080c-43ea-9881-7076d88b3ebf None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:53.695756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7b935d2b-080c-43ea-9881-7076d88b3ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:53.728682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122d584-133c-499d-b1b5-ae096ac28654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:53.729666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122d584-133c-499d-b1b5-ae096ac28654 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.729956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122d584-133c-499d-b1b5-ae096ac28654 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.730229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122d584-133c-499d-b1b5-ae096ac28654 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.731548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122d584-133c-499d-b1b5-ae096ac28654 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:53.733143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122d584-133c-499d-b1b5-ae096ac28654 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:53.735145 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 179/351] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:53 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:53.736419 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b1b8-4aad-4b4b-8471-ac591cbbfc24 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.736739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b1b8-4aad-4b4b-8471-ac591cbbfc24 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.737018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1807b1b8-4aad-4b4b-8471-ac591cbbfc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.756770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1807b1b8-4aad-4b4b-8471-ac591cbbfc24 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:53.758136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1807b1b8-4aad-4b4b-8471-ac591cbbfc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:53.763877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:53.775009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 173/352] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:53.776325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b935d2b-080c-43ea-9881-7076d88b3ebf None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:53.811074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:53.847617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 180/353] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:53.848516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807b1b8-4aad-4b4b-8471-ac591cbbfc24 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:53.910671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b935d2b-080c-43ea-9881-7076d88b3ebf None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:53.951450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4618-aff7-4ee1-b527-2ab1dd523f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:53.952723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4618-aff7-4ee1-b527-2ab1dd523f86 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:53.953005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4618-aff7-4ee1-b527-2ab1dd523f86 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:53.953279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e4618-aff7-4ee1-b527-2ab1dd523f86 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:53.954472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e4618-aff7-4ee1-b527-2ab1dd523f86 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:53.955933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e4618-aff7-4ee1-b527-2ab1dd523f86 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:53.958071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 174/354] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:53 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:53.958630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4618-aff7-4ee1-b527-2ab1dd523f86 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:53.982118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1807b1b8-4aad-4b4b-8471-ac591cbbfc24 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.027935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a952-ce8f-405b-95c2-74e7c9413ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:54.028863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a952-ce8f-405b-95c2-74e7c9413ffc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.029146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a952-ce8f-405b-95c2-74e7c9413ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.029551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:54.030174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a68a952-ce8f-405b-95c2-74e7c9413ffc None admin] PATH_INFO: `/v3/users/970881d160df4f91a331699119278609` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.031652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68a952-ce8f-405b-95c2-74e7c9413ffc None admin] RBAC: Authorizing `identity:get_user(user_id=970881d160df4f91a331699119278609)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:54.033152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a68a952-ce8f-405b-95c2-74e7c9413ffc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:54.034793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 181/355] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:15:53 2022] GET /identity/v3/users/970881d160df4f91a331699119278609 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:54.036739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a952-ce8f-405b-95c2-74e7c9413ffc None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:54.076163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e4618-aff7-4ee1-b527-2ab1dd523f86 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.095962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:54.118756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eaf779-cfdb-42cb-8090-4c467d18c466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:54.119639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaf779-cfdb-42cb-8090-4c467d18c466 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.119923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaf779-cfdb-42cb-8090-4c467d18c466 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.120201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eaf779-cfdb-42cb-8090-4c467d18c466 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.127867 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaf779-cfdb-42cb-8090-4c467d18c466 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:54.130404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eaf779-cfdb-42cb-8090-4c467d18c466 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:54.132401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 175/356] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:15:53 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:54.133844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579b43-7d67-4acd-9e75-78ca73fcf9bc None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.134137 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579b43-7d67-4acd-9e75-78ca73fcf9bc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.134413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b579b43-7d67-4acd-9e75-78ca73fcf9bc None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.136299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 176/357] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:54.136953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b579b43-7d67-4acd-9e75-78ca73fcf9bc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:54.162522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a68a952-ce8f-405b-95c2-74e7c9413ffc None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.209315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e977c-bd41-450b-b5fd-2fa1a7d44625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:54.209510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e977c-bd41-450b-b5fd-2fa1a7d44625 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.209712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e977c-bd41-450b-b5fd-2fa1a7d44625 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.211000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98e977c-bd41-450b-b5fd-2fa1a7d44625 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.222511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98e977c-bd41-450b-b5fd-2fa1a7d44625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d98e977c-bd41-450b-b5fd-2fa1a7d44625 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:54.230558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:54.231514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 182/358] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:54.232979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e977c-bd41-450b-b5fd-2fa1a7d44625 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:54.264163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b579b43-7d67-4acd-9e75-78ca73fcf9bc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.290601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:54.304047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041f24-4e31-4d3e-b25e-680cc2d8cef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:54.305550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041f24-4e31-4d3e-b25e-680cc2d8cef9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.305835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041f24-4e31-4d3e-b25e-680cc2d8cef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.311044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47041f24-4e31-4d3e-b25e-680cc2d8cef9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.319413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47041f24-4e31-4d3e-b25e-680cc2d8cef9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-47041f24-4e31-4d3e-b25e-680cc2d8cef9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:54.327820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:54.330160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:54.331203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:54.335321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 177/359] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:54.336186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041f24-4e31-4d3e-b25e-680cc2d8cef9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:54.358650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98e977c-bd41-450b-b5fd-2fa1a7d44625 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.360235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:54.400185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd2bce-b2ea-43b2-b672-f5f51b3eea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:54.401450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd2bce-b2ea-43b2-b672-f5f51b3eea87 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.401450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd2bce-b2ea-43b2-b672-f5f51b3eea87 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.401633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd2bce-b2ea-43b2-b672-f5f51b3eea87 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.402777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd2bce-b2ea-43b2-b672-f5f51b3eea87 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:54.404235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd2bce-b2ea-43b2-b672-f5f51b3eea87 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:54.408322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 183/360] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:15:54 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:54.408322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd2bce-b2ea-43b2-b672-f5f51b3eea87 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:54.462153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47041f24-4e31-4d3e-b25e-680cc2d8cef9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.508966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e56778-a8e0-4687-8af0-5cc67015d265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:54.509623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e56778-a8e0-4687-8af0-5cc67015d265 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.509905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e56778-a8e0-4687-8af0-5cc67015d265 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.510177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e56778-a8e0-4687-8af0-5cc67015d265 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.511004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e56778-a8e0-4687-8af0-5cc67015d265 None admin] RBAC: Adding query filter params (role.id=546050dd0a7a4c989b85134c093336a9, user.id=970881d160df4f91a331699119278609, scope.system=all) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:54.511311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e56778-a8e0-4687-8af0-5cc67015d265 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:54.513692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e56778-a8e0-4687-8af0-5cc67015d265 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:54.528170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 178/361] 10.222.0.24 () {56 vars in 1308 bytes} [Wed May 25 07:15:54 2022] GET /identity/v3/role_assignments?user.id=970881d160df4f91a331699119278609&scope.system=all&role.id=546050dd0a7a4c989b85134c093336a9 => generated 510 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:54.529472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4247-76ac-4b08-9583-b57172138351 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.529762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4247-76ac-4b08-9583-b57172138351 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.530038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1f4247-76ac-4b08-9583-b57172138351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.536570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd2bce-b2ea-43b2-b672-f5f51b3eea87 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.554467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ab1f4247-76ac-4b08-9583-b57172138351 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:54.556435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ab1f4247-76ac-4b08-9583-b57172138351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:54.600312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ffbdd-28f1-4209-824f-d62366e93caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:54.601580 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ffbdd-28f1-4209-824f-d62366e93caa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.601863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ffbdd-28f1-4209-824f-d62366e93caa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.602139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ffbdd-28f1-4209-824f-d62366e93caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.603003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ffbdd-28f1-4209-824f-d62366e93caa None admin] RBAC: Adding query filter params (group.id=3faeb13a21c24a5c91ae01333e352935, role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:54.603492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:54.603596 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ffbdd-28f1-4209-824f-d62366e93caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:54.606757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ffbdd-28f1-4209-824f-d62366e93caa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:54.615744 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 184/362] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:15:54 2022] GET /identity/v3/role_assignments?group.id=3faeb13a21c24a5c91ae01333e352935&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:54.617557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ffbdd-28f1-4209-824f-d62366e93caa None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:54.662126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 179/363] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:54.664070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f4247-76ac-4b08-9583-b57172138351 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:54.667510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:54.749838 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ffbdd-28f1-4209-824f-d62366e93caa None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.791568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215041a-72ff-4226-a027-8b420bf3e93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:54.791795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1f4247-76ac-4b08-9583-b57172138351 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.792258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215041a-72ff-4226-a027-8b420bf3e93f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.792565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215041a-72ff-4226-a027-8b420bf3e93f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.792842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0215041a-72ff-4226-a027-8b420bf3e93f None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.793736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215041a-72ff-4226-a027-8b420bf3e93f None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:54.794165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215041a-72ff-4226-a027-8b420bf3e93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:54.795599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0215041a-72ff-4226-a027-8b420bf3e93f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:54.809613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 185/364] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:54.810589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215041a-72ff-4226-a027-8b420bf3e93f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:54.840321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd97822-61da-44f5-9f85-a1b3a89ed14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:54.841047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97822-61da-44f5-9f85-a1b3a89ed14c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:54.841451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97822-61da-44f5-9f85-a1b3a89ed14c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:54.841987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd97822-61da-44f5-9f85-a1b3a89ed14c None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:54.842755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd97822-61da-44f5-9f85-a1b3a89ed14c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:54.843064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd97822-61da-44f5-9f85-a1b3a89ed14c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:54.844653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd97822-61da-44f5-9f85-a1b3a89ed14c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:54.856101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 180/365] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:54.857362 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd97822-61da-44f5-9f85-a1b3a89ed14c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:54.895438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:54.953962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0215041a-72ff-4226-a027-8b420bf3e93f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:54.956917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:54.986440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd97822-61da-44f5-9f85-a1b3a89ed14c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:55.010035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1390f-f768-4395-b614-adcd09a074aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:55.010622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1390f-f768-4395-b614-adcd09a074aa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:55.010903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1390f-f768-4395-b614-adcd09a074aa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:55.011174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1390f-f768-4395-b614-adcd09a074aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:55.012016 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1390f-f768-4395-b614-adcd09a074aa None admin] RBAC: Adding query filter params (group.id=3faeb13a21c24a5c91ae01333e352935, role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:55.012331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1390f-f768-4395-b614-adcd09a074aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:55.013804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1390f-f768-4395-b614-adcd09a074aa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:55.020127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 186/366] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:15:54 2022] GET /identity/v3/role_assignments?group.id=3faeb13a21c24a5c91ae01333e352935&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=3e26988f292a493c8351b566b43239e2 => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:55.020912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1390f-f768-4395-b614-adcd09a074aa None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:55.034262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0d7a4-0d13-4629-85c4-1cd50e9a97ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:55.036662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0d7a4-0d13-4629-85c4-1cd50e9a97ba None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:55.037206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0d7a4-0d13-4629-85c4-1cd50e9a97ba None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:55.037688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0d7a4-0d13-4629-85c4-1cd50e9a97ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:55.056229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0d7a4-0d13-4629-85c4-1cd50e9a97ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-71a0d7a4-0d13-4629-85c4-1cd50e9a97ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:55.068419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:55.069618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:15:55.070461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:55.074377 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 181/367] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:15:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:55.075437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0d7a4-0d13-4629-85c4-1cd50e9a97ba None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:55.190652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:55.201426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0d7a4-0d13-4629-85c4-1cd50e9a97ba None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:55.223592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1390f-f768-4395-b614-adcd09a074aa None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:55.251773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc55ac-3baa-4299-ad96-6ba6fce0132c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:55.252890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc55ac-3baa-4299-ad96-6ba6fce0132c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:55.253349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc55ac-3baa-4299-ad96-6ba6fce0132c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:55.253802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc55ac-3baa-4299-ad96-6ba6fce0132c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:55.272674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad415e2e-e0e1-4660-a322-0b6a5dcff12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:55.273360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad415e2e-e0e1-4660-a322-0b6a5dcff12d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:55.274012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad415e2e-e0e1-4660-a322-0b6a5dcff12d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:55.274293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad415e2e-e0e1-4660-a322-0b6a5dcff12d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:55.309978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:55.341552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc55ac-3baa-4299-ad96-6ba6fce0132c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:55.344523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc55ac-3baa-4299-ad96-6ba6fce0132c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:55.370016 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad415e2e-e0e1-4660-a322-0b6a5dcff12d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:55.373517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad415e2e-e0e1-4660-a322-0b6a5dcff12d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:55.465490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:55.476533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 182/368] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:55.477478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc55ac-3baa-4299-ad96-6ba6fce0132c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:55.504402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 187/369] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:55.506130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad415e2e-e0e1-4660-a322-0b6a5dcff12d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:55.590484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:55.601282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc55ac-3baa-4299-ad96-6ba6fce0132c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:55.644379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e599748-b9f9-48e1-ae57-b9ec5678963a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:55.645352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e599748-b9f9-48e1-ae57-b9ec5678963a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:55.645727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e599748-b9f9-48e1-ae57-b9ec5678963a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:55.646076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e599748-b9f9-48e1-ae57-b9ec5678963a None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:55.647235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e599748-b9f9-48e1-ae57-b9ec5678963a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:55.647891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e599748-b9f9-48e1-ae57-b9ec5678963a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:55.649549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e599748-b9f9-48e1-ae57-b9ec5678963a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:55.653489 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad415e2e-e0e1-4660-a322-0b6a5dcff12d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:55.660240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 183/370] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:55.661197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e599748-b9f9-48e1-ae57-b9ec5678963a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:55.703343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480263b6-2eed-48c7-bb37-d553907e5048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:55.704574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480263b6-2eed-48c7-bb37-d553907e5048 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:55.705030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480263b6-2eed-48c7-bb37-d553907e5048 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:55.705474 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480263b6-2eed-48c7-bb37-d553907e5048 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:55.706891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480263b6-2eed-48c7-bb37-d553907e5048 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:55.709010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480263b6-2eed-48c7-bb37-d553907e5048 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:55.711719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 188/371] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:55 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:55.713058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480263b6-2eed-48c7-bb37-d553907e5048 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:55.724645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:55.770742 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e599748-b9f9-48e1-ae57-b9ec5678963a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:55.806389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90624312-eff9-48fd-9cd9-9983a264bfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:55.807267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90624312-eff9-48fd-9cd9-9983a264bfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:55.807546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90624312-eff9-48fd-9cd9-9983a264bfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:55.807822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90624312-eff9-48fd-9cd9-9983a264bfb2 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:55.813202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90624312-eff9-48fd-9cd9-9983a264bfb2 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:55.815197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90624312-eff9-48fd-9cd9-9983a264bfb2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:55.820557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 184/372] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:55 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:55.821568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90624312-eff9-48fd-9cd9-9983a264bfb2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:55.848581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480263b6-2eed-48c7-bb37-d553907e5048 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:55.882059 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:55.892167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401b85-e1e7-4be4-aef0-b501947c8f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:55.893356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401b85-e1e7-4be4-aef0-b501947c8f87 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:55.907325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401b85-e1e7-4be4-aef0-b501947c8f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:55.907325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401b85-e1e7-4be4-aef0-b501947c8f87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:55.954400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90624312-eff9-48fd-9cd9-9983a264bfb2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:55.985052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:55.985991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401b85-e1e7-4be4-aef0-b501947c8f87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:55.987944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401b85-e1e7-4be4-aef0-b501947c8f87 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:55.998621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e5ee5-8bec-4f0c-bb7d-5de39533bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:55.999935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e5ee5-8bec-4f0c-bb7d-5de39533bc02 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:56.000225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e5ee5-8bec-4f0c-bb7d-5de39533bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:56.000519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e5ee5-8bec-4f0c-bb7d-5de39533bc02 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:56.007717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e5ee5-8bec-4f0c-bb7d-5de39533bc02 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:56.007717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e5ee5-8bec-4f0c-bb7d-5de39533bc02 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:56.007717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 185/373] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:15:55 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:56.008572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e5ee5-8bec-4f0c-bb7d-5de39533bc02 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:56.092227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 189/374] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:15:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:15:56.093142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401b85-e1e7-4be4-aef0-b501947c8f87 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:56.125448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:56.134932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e5ee5-8bec-4f0c-bb7d-5de39533bc02 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:56.169461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467f6f-7897-4be1-87c7-6f5f4c1c6323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:56.170534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467f6f-7897-4be1-87c7-6f5f4c1c6323 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:56.170818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467f6f-7897-4be1-87c7-6f5f4c1c6323 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:56.171093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75467f6f-7897-4be1-87c7-6f5f4c1c6323 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:56.172275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75467f6f-7897-4be1-87c7-6f5f4c1c6323 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:56.173744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75467f6f-7897-4be1-87c7-6f5f4c1c6323 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:56.175453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 186/375] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:15:56 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:56.176198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467f6f-7897-4be1-87c7-6f5f4c1c6323 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:56.206882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401b85-e1e7-4be4-aef0-b501947c8f87 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:56.244806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d914dd-4a47-4537-86d7-da3aa59c00bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:56.245535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d914dd-4a47-4537-86d7-da3aa59c00bf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:56.245731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d914dd-4a47-4537-86d7-da3aa59c00bf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:56.246010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d914dd-4a47-4537-86d7-da3aa59c00bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:56.246833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d914dd-4a47-4537-86d7-da3aa59c00bf None admin] RBAC: Adding query filter params (group.id=3faeb13a21c24a5c91ae01333e352935, role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:56.247142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d914dd-4a47-4537-86d7-da3aa59c00bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:56.248594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d914dd-4a47-4537-86d7-da3aa59c00bf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:56.254770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 190/376] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:15:56 2022] GET /identity/v3/role_assignments?group.id=3faeb13a21c24a5c91ae01333e352935&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=3e26988f292a493c8351b566b43239e2 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:56.255544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d914dd-4a47-4537-86d7-da3aa59c00bf None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:56.258040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:56.316985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75467f6f-7897-4be1-87c7-6f5f4c1c6323 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:56.390515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b2400-2ef3-4247-b1ff-005957f42ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:56.391567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b2400-2ef3-4247-b1ff-005957f42ccb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:56.391849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b2400-2ef3-4247-b1ff-005957f42ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:56.393604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961b2400-2ef3-4247-b1ff-005957f42ccb None admin] PATH_INFO: `/v3/projects/c4db8d1f990d4445ab6059278607233e` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:56.395658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:56.395784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b2400-2ef3-4247-b1ff-005957f42ccb None admin] RBAC: Authorizing `identity:get_project(project_id=c4db8d1f990d4445ab6059278607233e)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:56.397170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961b2400-2ef3-4247-b1ff-005957f42ccb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:56.407843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 187/377] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:56 2022] GET /identity/v3/projects/c4db8d1f990d4445ab6059278607233e => generated 344 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:56.410727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b2400-2ef3-4247-b1ff-005957f42ccb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:56.418855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d914dd-4a47-4537-86d7-da3aa59c00bf None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:56.495484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eb1f1-40dd-4996-8f1b-b7672950cfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:56.496625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eb1f1-40dd-4996-8f1b-b7672950cfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:56.496914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eb1f1-40dd-4996-8f1b-b7672950cfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:56.497183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4eb1f1-40dd-4996-8f1b-b7672950cfc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:56.498438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eb1f1-40dd-4996-8f1b-b7672950cfc7 None admin] RBAC: Adding query filter params (group.id=3faeb13a21c24a5c91ae01333e352935, role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:56.498755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eb1f1-40dd-4996-8f1b-b7672950cfc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:56.500199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4eb1f1-40dd-4996-8f1b-b7672950cfc7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:56.513487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 191/378] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:15:56 2022] GET /identity/v3/role_assignments?group.id=3faeb13a21c24a5c91ae01333e352935&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:56.579891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961b2400-2ef3-4247-b1ff-005957f42ccb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:56.624448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:56.634736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f572-f622-42f1-935c-9308c6031109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:56.635949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f572-f622-42f1-935c-9308c6031109 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:56.642680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f572-f622-42f1-935c-9308c6031109 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:56.642680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f572-f622-42f1-935c-9308c6031109 None admin] PATH_INFO: `/v3/groups/e3c4f97a4faa4fc79b1e2481cd77e580` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:56.646422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7f572-f622-42f1-935c-9308c6031109 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c4f97a4faa4fc79b1e2481cd77e580)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:56.649041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7f572-f622-42f1-935c-9308c6031109 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:56.651387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 188/379] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:15:56 2022] GET /identity/v3/groups/e3c4f97a4faa4fc79b1e2481cd77e580 => generated 229 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:56.657115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eb1f1-40dd-4996-8f1b-b7672950cfc7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:56.785677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4eb1f1-40dd-4996-8f1b-b7672950cfc7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:56.822578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0349ede0-a538-414b-8e45-1d0fb967649c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:56.823293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349ede0-a538-414b-8e45-1d0fb967649c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:56.823573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349ede0-a538-414b-8e45-1d0fb967649c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:56.823848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0349ede0-a538-414b-8e45-1d0fb967649c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:56.824763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349ede0-a538-414b-8e45-1d0fb967649c None admin] RBAC: Adding query filter params (group.id=e3c4f97a4faa4fc79b1e2481cd77e580, role.id=7c09d078126441909df0a46212ffea63, scope.project.id=c4db8d1f990d4445ab6059278607233e) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:56.825075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349ede0-a538-414b-8e45-1d0fb967649c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:56.826511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0349ede0-a538-414b-8e45-1d0fb967649c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:56.832770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 192/380] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:15:56 2022] GET /identity/v3/role_assignments?group.id=e3c4f97a4faa4fc79b1e2481cd77e580&scope.project.id=c4db8d1f990d4445ab6059278607233e&role.id=7c09d078126441909df0a46212ffea63 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:57.235448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2e511-5aff-4801-ac5f-ffcfdac378e8 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:57.236313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2e511-5aff-4801-ac5f-ffcfdac378e8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:57.236757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2e511-5aff-4801-ac5f-ffcfdac378e8 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:57.238565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 189/381] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:57.244395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89583e-5518-4899-954a-c7d1fc794878 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:57.244893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89583e-5518-4899-954a-c7d1fc794878 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:57.245722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89583e-5518-4899-954a-c7d1fc794878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:57.273817 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2b89583e-5518-4899-954a-c7d1fc794878 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:57.275259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2b89583e-5518-4899-954a-c7d1fc794878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:57.291993 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:57.357159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 193/382] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:57.390711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2e511-5aff-4801-ac5f-ffcfdac378e8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:57.511671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2e511-5aff-4801-ac5f-ffcfdac378e8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:57.545937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e7a17-a910-4b3a-a07f-c9432b43a434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:57.546741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e7a17-a910-4b3a-a07f-c9432b43a434 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:57.547023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e7a17-a910-4b3a-a07f-c9432b43a434 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:57.547300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e7a17-a910-4b3a-a07f-c9432b43a434 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:57.558008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e7a17-a910-4b3a-a07f-c9432b43a434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ae2e7a17-a910-4b3a-a07f-c9432b43a434 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:57.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:57.568625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:57.570199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 190/383] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:15:57.575815 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89583e-5518-4899-954a-c7d1fc794878 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:57.637966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553062c-2a69-43b5-a7ac-0240cbca5f43 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:57.639156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553062c-2a69-43b5-a7ac-0240cbca5f43 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:57.639737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0553062c-2a69-43b5-a7ac-0240cbca5f43 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:57.642360 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 191/384] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:57.650008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf1b0-67b1-4270-8f1a-38d27de0b67e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:57.650484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf1b0-67b1-4270-8f1a-38d27de0b67e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:57.650911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bf1b0-67b1-4270-8f1a-38d27de0b67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:57.681999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-db7bf1b0-67b1-4270-8f1a-38d27de0b67e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:57.683192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-db7bf1b0-67b1-4270-8f1a-38d27de0b67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:57.750310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89583e-5518-4899-954a-c7d1fc794878 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:57.775438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:57.810043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 192/385] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:57.818341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ba30-50c4-4957-b1e0-f56fdde8e351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:57.819014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ba30-50c4-4957-b1e0-f56fdde8e351 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:57.819905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ba30-50c4-4957-b1e0-f56fdde8e351 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:57.820177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6710ba30-50c4-4957-b1e0-f56fdde8e351 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:57.821188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710ba30-50c4-4957-b1e0-f56fdde8e351 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:57.821497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710ba30-50c4-4957-b1e0-f56fdde8e351 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:57.822932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6710ba30-50c4-4957-b1e0-f56fdde8e351 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:57.836610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 194/386] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:57.842536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf1b0-67b1-4270-8f1a-38d27de0b67e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:57.870488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ba30-50c4-4957-b1e0-f56fdde8e351 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:57.891585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:58.017411 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bf1b0-67b1-4270-8f1a-38d27de0b67e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:58.055076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6710ba30-50c4-4957-b1e0-f56fdde8e351 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:58.080010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d8426-4faf-434f-b67f-746c79326900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:58.080899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d8426-4faf-434f-b67f-746c79326900 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:58.081176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d8426-4faf-434f-b67f-746c79326900 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:58.081445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d8426-4faf-434f-b67f-746c79326900 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:58.082748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d8426-4faf-434f-b67f-746c79326900 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:58.084185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d8426-4faf-434f-b67f-746c79326900 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:58.086693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 193/387] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:15:57 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:58.097423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d8426-4faf-434f-b67f-746c79326900 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:58.109062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49751-802d-4431-a06a-752bc735bd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:58.110236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49751-802d-4431-a06a-752bc735bd6f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:58.110700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49751-802d-4431-a06a-752bc735bd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:58.111536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b49751-802d-4431-a06a-752bc735bd6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:58.135637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b49751-802d-4431-a06a-752bc735bd6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e1b49751-802d-4431-a06a-752bc735bd6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:58.150766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:58.151663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:58.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:58.157258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 195/388] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:58.164104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49751-802d-4431-a06a-752bc735bd6f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:58.191122 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:58.255396 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:58.298853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d8426-4faf-434f-b67f-746c79326900 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:58.301282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b49751-802d-4431-a06a-752bc735bd6f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:58.359883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c89839-8d26-4000-90c2-509fb4db9ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:58.361146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c89839-8d26-4000-90c2-509fb4db9ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:58.361649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c89839-8d26-4000-90c2-509fb4db9ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:58.362122 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c89839-8d26-4000-90c2-509fb4db9ff4 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:58.363532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c89839-8d26-4000-90c2-509fb4db9ff4 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:58.365294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c89839-8d26-4000-90c2-509fb4db9ff4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:58.367601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ea46-0469-45db-814b-5d17b5201596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:58.368445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 194/389] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:58 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:58.371762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ea46-0469-45db-814b-5d17b5201596 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:58.371762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ea46-0469-45db-814b-5d17b5201596 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:58.371762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520ea46-0469-45db-814b-5d17b5201596 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:58.371762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ea46-0469-45db-814b-5d17b5201596 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:58.371762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ea46-0469-45db-814b-5d17b5201596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:58.372880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c89839-8d26-4000-90c2-509fb4db9ff4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:58.373831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5520ea46-0469-45db-814b-5d17b5201596 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:58.395301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 196/390] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:58.401830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ea46-0469-45db-814b-5d17b5201596 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:58.579496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c89839-8d26-4000-90c2-509fb4db9ff4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:58.617059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:58.625905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520ea46-0469-45db-814b-5d17b5201596 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:58.652828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984c221-154d-41ee-9f2a-07f98144918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:58.653719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984c221-154d-41ee-9f2a-07f98144918b None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:58.653998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984c221-154d-41ee-9f2a-07f98144918b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:58.654266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e984c221-154d-41ee-9f2a-07f98144918b None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/groups/3faeb13a21c24a5c91ae01333e352935/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:58.660002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984c221-154d-41ee-9f2a-07f98144918b None admin] RBAC: Authorizing `identity:create_grant(project_id=f8518c8e5e874ff6806e967ca32ffaca, group_id=3faeb13a21c24a5c91ae01333e352935, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:58.661482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e984c221-154d-41ee-9f2a-07f98144918b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:58.689233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcaeca-dacb-4035-9743-dd2b516aca8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:58.690105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcaeca-dacb-4035-9743-dd2b516aca8a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:58.690379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcaeca-dacb-4035-9743-dd2b516aca8a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:58.690649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcaeca-dacb-4035-9743-dd2b516aca8a None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:58.691868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcaeca-dacb-4035-9743-dd2b516aca8a None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:58.693461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfcaeca-dacb-4035-9743-dd2b516aca8a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:58.695663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 197/391] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:15:58 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:58.701041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcaeca-dacb-4035-9743-dd2b516aca8a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:58.704336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:58.740610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 195/392] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 07:15:58 2022] PUT /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/groups/3faeb13a21c24a5c91ae01333e352935/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:15:58.828390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcaeca-dacb-4035-9743-dd2b516aca8a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:58.864765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8925e-cd24-4279-b239-535c862352bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:58.865661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8925e-cd24-4279-b239-535c862352bf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:58.866479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8925e-cd24-4279-b239-535c862352bf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:58.867529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8925e-cd24-4279-b239-535c862352bf None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:58.868916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8925e-cd24-4279-b239-535c862352bf None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:58.870388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8925e-cd24-4279-b239-535c862352bf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:58.872428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 198/393] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:58 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:58.878322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984c221-154d-41ee-9f2a-07f98144918b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:58.987628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8a63-9b9b-46b5-8701-a4d7df7bbf3b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:58.988338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8a63-9b9b-46b5-8701-a4d7df7bbf3b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:58.988868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3e8a63-9b9b-46b5-8701-a4d7df7bbf3b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:58.990732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 199/394] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:58.997265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a122-5d4e-4944-b37e-36e149eb1571 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:58.997919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a122-5d4e-4944-b37e-36e149eb1571 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:58.998402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf7a122-5d4e-4944-b37e-36e149eb1571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.023342 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e984c221-154d-41ee-9f2a-07f98144918b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:59.026579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-abf7a122-5d4e-4944-b37e-36e149eb1571 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:59.029012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-abf7a122-5d4e-4944-b37e-36e149eb1571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:59.094846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd15aa4-ad71-4a7e-b1cb-d59d62f4a350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:59.096095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd15aa4-ad71-4a7e-b1cb-d59d62f4a350 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.096663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd15aa4-ad71-4a7e-b1cb-d59d62f4a350 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.097142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd15aa4-ad71-4a7e-b1cb-d59d62f4a350 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/groups/3faeb13a21c24a5c91ae01333e352935/roles/3e26988f292a493c8351b566b43239e2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.099828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd15aa4-ad71-4a7e-b1cb-d59d62f4a350 None admin] RBAC: Authorizing `identity:create_grant(project_id=f8518c8e5e874ff6806e967ca32ffaca, group_id=3faeb13a21c24a5c91ae01333e352935, role_id=3e26988f292a493c8351b566b43239e2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:59.101577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd15aa4-ad71-4a7e-b1cb-d59d62f4a350 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:59.134031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:59.138831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 200/395] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:15:59.164989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7a122-5d4e-4944-b37e-36e149eb1571 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:59.180103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 196/396] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 07:15:58 2022] PUT /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca/groups/3faeb13a21c24a5c91ae01333e352935/roles/3e26988f292a493c8351b566b43239e2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:15:59.183116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474bbab-ef4c-450a-90d8-f1e933cd22af None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.183984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474bbab-ef4c-450a-90d8-f1e933cd22af None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.184538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9474bbab-ef4c-450a-90d8-f1e933cd22af None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.186839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 197/397] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:15:59.195044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a295fd1-a667-4520-97e1-5d56f00f0e2a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.195828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a295fd1-a667-4520-97e1-5d56f00f0e2a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.196328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a295fd1-a667-4520-97e1-5d56f00f0e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.240900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6a295fd1-a667-4520-97e1-5d56f00f0e2a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:59.244328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6a295fd1-a667-4520-97e1-5d56f00f0e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:59.298528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:59.349402 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 198/398] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 25 07:15:59.385857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a295fd1-a667-4520-97e1-5d56f00f0e2a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:59.391736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf7a122-5d4e-4944-b37e-36e149eb1571 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:59.431424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9ac8-e47d-4ef7-a48c-64736063b4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:59.432334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9ac8-e47d-4ef7-a48c-64736063b4dc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.432655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9ac8-e47d-4ef7-a48c-64736063b4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.432929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4a9ac8-e47d-4ef7-a48c-64736063b4dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.445422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4a9ac8-e47d-4ef7-a48c-64736063b4dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9e4a9ac8-e47d-4ef7-a48c-64736063b4dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:59.454381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:59.455329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:15:59.456123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 201/399] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:15:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:59.463112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9ac8-e47d-4ef7-a48c-64736063b4dc None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:59.525217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a295fd1-a667-4520-97e1-5d56f00f0e2a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:59.559895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:59.599435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107cb4c-852c-4e7f-a084-e3a61523814b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:59.600249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107cb4c-852c-4e7f-a084-e3a61523814b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.600629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107cb4c-852c-4e7f-a084-e3a61523814b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.601118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107cb4c-852c-4e7f-a084-e3a61523814b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.624982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107cb4c-852c-4e7f-a084-e3a61523814b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f107cb4c-852c-4e7f-a084-e3a61523814b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:15:59.636056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:15:59.637018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:15:59.638267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 199/400] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:15:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:15:59.643617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107cb4c-852c-4e7f-a084-e3a61523814b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:59.658403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4a9ac8-e47d-4ef7-a48c-64736063b4dc None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:59.695736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:59.711236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54740a0f-af99-4379-9df3-a91a868790a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:59.711906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740a0f-af99-4379-9df3-a91a868790a8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.712185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740a0f-af99-4379-9df3-a91a868790a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.712455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54740a0f-af99-4379-9df3-a91a868790a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.713248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54740a0f-af99-4379-9df3-a91a868790a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:59.713552 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54740a0f-af99-4379-9df3-a91a868790a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:59.714915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54740a0f-af99-4379-9df3-a91a868790a8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:59.724207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 202/401] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:15:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:59.726128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df63ac-516a-4e21-89af-4b8dc4e007f6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.726410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df63ac-516a-4e21-89af-4b8dc4e007f6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.726686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df63ac-516a-4e21-89af-4b8dc4e007f6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.728657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 203/402] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:15:59.730629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df63ac-516a-4e21-89af-4b8dc4e007f6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:59.778753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107cb4c-852c-4e7f-a084-e3a61523814b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:59.815560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2b34fc-bcc2-48bc-b2b9-d1c88e5ba553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:59.816234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b34fc-bcc2-48bc-b2b9-d1c88e5ba553 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.816542 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b34fc-bcc2-48bc-b2b9-d1c88e5ba553 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.816821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2b34fc-bcc2-48bc-b2b9-d1c88e5ba553 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.817637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b34fc-bcc2-48bc-b2b9-d1c88e5ba553 None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:15:59.817952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b34fc-bcc2-48bc-b2b9-d1c88e5ba553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:59.820328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2b34fc-bcc2-48bc-b2b9-d1c88e5ba553 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:59.832750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 200/403] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:15:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:59.834090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778d3f9-399d-466f-a21e-c9069901caad None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.834384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778d3f9-399d-466f-a21e-c9069901caad None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.834667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778d3f9-399d-466f-a21e-c9069901caad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.855837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1778d3f9-399d-466f-a21e-c9069901caad None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:15:59.856345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df63ac-516a-4e21-89af-4b8dc4e007f6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:15:59.857092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1778d3f9-399d-466f-a21e-c9069901caad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:15:59.889714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:15:59.905282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03c7d-5b60-4cd9-94f4-3cb046170ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:15:59.906350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03c7d-5b60-4cd9-94f4-3cb046170ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:15:59.906796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03c7d-5b60-4cd9-94f4-3cb046170ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:15:59.907643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e03c7d-5b60-4cd9-94f4-3cb046170ce0 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:15:59.909387 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e03c7d-5b60-4cd9-94f4-3cb046170ce0 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:15:59.911542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e03c7d-5b60-4cd9-94f4-3cb046170ce0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:15:59.915163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 204/404] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:15:59 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:15:59.916443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03c7d-5b60-4cd9-94f4-3cb046170ce0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:59.935432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 201/405] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:15:59.936946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778d3f9-399d-466f-a21e-c9069901caad None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:15:59.976450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:00.049451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e03c7d-5b60-4cd9-94f4-3cb046170ce0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:00.072026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778d3f9-399d-466f-a21e-c9069901caad None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:00.086056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9101e91-f786-4ed9-b6b8-525a199d32d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:00.087314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101e91-f786-4ed9-b6b8-525a199d32d5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:00.088110 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101e91-f786-4ed9-b6b8-525a199d32d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:00.088570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101e91-f786-4ed9-b6b8-525a199d32d5 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:00.090366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9101e91-f786-4ed9-b6b8-525a199d32d5 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:00.092566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9101e91-f786-4ed9-b6b8-525a199d32d5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:00.094950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 205/406] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:15:59 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:00.095885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9101e91-f786-4ed9-b6b8-525a199d32d5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:00.114487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f94d3-fdee-422a-91a2-f8ae9976649f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:00.115415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f94d3-fdee-422a-91a2-f8ae9976649f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:00.115641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f94d3-fdee-422a-91a2-f8ae9976649f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:00.116501 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f94d3-fdee-422a-91a2-f8ae9976649f None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:00.118241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f94d3-fdee-422a-91a2-f8ae9976649f None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:00.119773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f94d3-fdee-422a-91a2-f8ae9976649f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:00.121848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 202/407] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:15:59 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:00.122632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f94d3-fdee-422a-91a2-f8ae9976649f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:00.167907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:00.221624 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9101e91-f786-4ed9-b6b8-525a199d32d5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:00.235051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:00.252831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f94d3-fdee-422a-91a2-f8ae9976649f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:00.268363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f188b-65dd-46ac-b0cf-afdda785e0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:00.270037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f188b-65dd-46ac-b0cf-afdda785e0cf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:00.271129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f188b-65dd-46ac-b0cf-afdda785e0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:00.271698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f188b-65dd-46ac-b0cf-afdda785e0cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:00.286321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f188b-65dd-46ac-b0cf-afdda785e0cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:00.292904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c6da8-95c3-46cd-b6d4-3a3dd0d20227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:00.293849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c6da8-95c3-46cd-b6d4-3a3dd0d20227 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:00.294344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c6da8-95c3-46cd-b6d4-3a3dd0d20227 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:00.294690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c6da8-95c3-46cd-b6d4-3a3dd0d20227 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:00.295977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c6da8-95c3-46cd-b6d4-3a3dd0d20227 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ca0f188b-65dd-46ac-b0cf-afdda785e0cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:00.296272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:00.297383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:00.298421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:00.299394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c6da8-95c3-46cd-b6d4-3a3dd0d20227 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:00.300972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 206/408] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:00.301872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f188b-65dd-46ac-b0cf-afdda785e0cf None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:00.306561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 203/409] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:16:00 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:00.313664 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c6da8-95c3-46cd-b6d4-3a3dd0d20227 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:00.419549 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f188b-65dd-46ac-b0cf-afdda785e0cf None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:00.434997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c6da8-95c3-46cd-b6d4-3a3dd0d20227 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:00.437356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:00.455423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4910c70-c269-47e1-8179-14f20681e767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:00.456395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4910c70-c269-47e1-8179-14f20681e767 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:00.456795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4910c70-c269-47e1-8179-14f20681e767 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:00.457141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4910c70-c269-47e1-8179-14f20681e767 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/groups/3faeb13a21c24a5c91ae01333e352935/roles/3e26988f292a493c8351b566b43239e2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:00.460368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4910c70-c269-47e1-8179-14f20681e767 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fb33448368d4b45a3d0f28261a78d5d, group_id=3faeb13a21c24a5c91ae01333e352935, role_id=3e26988f292a493c8351b566b43239e2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:00.462536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4910c70-c269-47e1-8179-14f20681e767 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:00.474682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f61378-c1a4-4d14-9e87-53fe496209bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:00.476557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f61378-c1a4-4d14-9e87-53fe496209bb None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:00.477064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f61378-c1a4-4d14-9e87-53fe496209bb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:00.477581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f61378-c1a4-4d14-9e87-53fe496209bb None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/groups/3faeb13a21c24a5c91ae01333e352935/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:00.480200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f61378-c1a4-4d14-9e87-53fe496209bb None admin] RBAC: Authorizing `identity:create_grant(project_id=3fb33448368d4b45a3d0f28261a78d5d, group_id=3faeb13a21c24a5c91ae01333e352935, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:00.482032 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f61378-c1a4-4d14-9e87-53fe496209bb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:00.544509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 207/410] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 07:16:00 2022] PUT /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/groups/3faeb13a21c24a5c91ae01333e352935/roles/3e26988f292a493c8351b566b43239e2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:16:00.545645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4910c70-c269-47e1-8179-14f20681e767 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:00.623931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 204/411] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 07:16:00 2022] PUT /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d/groups/3faeb13a21c24a5c91ae01333e352935/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:16:00.680445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4910c70-c269-47e1-8179-14f20681e767 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:00.723181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32834b-1dc8-43bd-b234-0c937f01709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:00.723883 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32834b-1dc8-43bd-b234-0c937f01709e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:00.724168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32834b-1dc8-43bd-b234-0c937f01709e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:00.724448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32834b-1dc8-43bd-b234-0c937f01709e None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:00.725247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32834b-1dc8-43bd-b234-0c937f01709e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:00.726084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32834b-1dc8-43bd-b234-0c937f01709e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:00.728044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32834b-1dc8-43bd-b234-0c937f01709e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:00.738463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 208/412] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:00.750625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f61378-c1a4-4d14-9e87-53fe496209bb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:00.780064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:00.885112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f61378-c1a4-4d14-9e87-53fe496209bb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:00.927035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b4a6a-be0e-42ed-986e-c04c72213038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:00.928294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b4a6a-be0e-42ed-986e-c04c72213038 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:00.929450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b4a6a-be0e-42ed-986e-c04c72213038 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:00.930150 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b4a6a-be0e-42ed-986e-c04c72213038 None admin] PATH_INFO: `/v3/groups/e3c4f97a4faa4fc79b1e2481cd77e580` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:00.933144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b4a6a-be0e-42ed-986e-c04c72213038 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c4f97a4faa4fc79b1e2481cd77e580)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:00.934829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b4a6a-be0e-42ed-986e-c04c72213038 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:00.936761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 205/413] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:16:00 2022] GET /identity/v3/groups/e3c4f97a4faa4fc79b1e2481cd77e580 => generated 229 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:00.942514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32834b-1dc8-43bd-b234-0c937f01709e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:00.990370 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:01.067479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32834b-1dc8-43bd-b234-0c937f01709e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:01.117150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b986d7-b0d0-4328-9350-b31d26cf388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:01.118020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b986d7-b0d0-4328-9350-b31d26cf388a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:01.118311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b986d7-b0d0-4328-9350-b31d26cf388a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:01.118567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b986d7-b0d0-4328-9350-b31d26cf388a None admin] PATH_INFO: `/v3/projects/c4db8d1f990d4445ab6059278607233e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:01.125224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b986d7-b0d0-4328-9350-b31d26cf388a None admin] RBAC: Authorizing `identity:get_project(project_id=c4db8d1f990d4445ab6059278607233e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:01.126676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b986d7-b0d0-4328-9350-b31d26cf388a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:01.128725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 209/414] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:16:00 2022] GET /identity/v3/projects/c4db8d1f990d4445ab6059278607233e => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:01.134414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b4a6a-be0e-42ed-986e-c04c72213038 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:01.280361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:01.304392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b4a6a-be0e-42ed-986e-c04c72213038 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:01.354345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e94a56-f368-41dd-8a45-2c52676b62d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:01.355241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e94a56-f368-41dd-8a45-2c52676b62d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:01.355521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e94a56-f368-41dd-8a45-2c52676b62d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:01.355796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e94a56-f368-41dd-8a45-2c52676b62d1 None admin] PATH_INFO: `/v3/projects/c4db8d1f990d4445ab6059278607233e/groups/e3c4f97a4faa4fc79b1e2481cd77e580/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:01.361776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e94a56-f368-41dd-8a45-2c52676b62d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4db8d1f990d4445ab6059278607233e, group_id=e3c4f97a4faa4fc79b1e2481cd77e580, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:01.363237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e94a56-f368-41dd-8a45-2c52676b62d1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:01.431732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11682a6-31e3-4773-bc11-ed0a91081206 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:01.432236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11682a6-31e3-4773-bc11-ed0a91081206 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:01.432310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11682a6-31e3-4773-bc11-ed0a91081206 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:01.433934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 210/415] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:16:01.438896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82e8ae-60c5-497b-b227-63fb469f89ca None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:01.439180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82e8ae-60c5-497b-b227-63fb469f89ca None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:01.439453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82e8ae-60c5-497b-b227-63fb469f89ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:01.452160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 206/416] 10.222.0.24 () {58 vars in 1442 bytes} [Wed May 25 07:16:01 2022] PUT /identity/v3/projects/c4db8d1f990d4445ab6059278607233e/groups/e3c4f97a4faa4fc79b1e2481cd77e580/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:16:01.458658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9c82e8ae-60c5-497b-b227-63fb469f89ca None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:01.460770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9c82e8ae-60c5-497b-b227-63fb469f89ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:01.578958 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 211/417] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:16:01.619290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e94a56-f368-41dd-8a45-2c52676b62d1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:01.708557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248654-2147-41dc-acee-c92fc18e3771 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:01.709184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248654-2147-41dc-acee-c92fc18e3771 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:01.709184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5248654-2147-41dc-acee-c92fc18e3771 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:01.711034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 212/418] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:16:01.716257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feda967-6ce9-4837-b88b-1333e729ea4e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:01.716899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feda967-6ce9-4837-b88b-1333e729ea4e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:01.717252 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feda967-6ce9-4837-b88b-1333e729ea4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:01.738818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1feda967-6ce9-4837-b88b-1333e729ea4e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:01.740364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1feda967-6ce9-4837-b88b-1333e729ea4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:01.750828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e94a56-f368-41dd-8a45-2c52676b62d1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:01.781087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:01.797377 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd17ca-1709-4c27-8ff5-002fb794d2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:01.798488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd17ca-1709-4c27-8ff5-002fb794d2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:01.798953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd17ca-1709-4c27-8ff5-002fb794d2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:01.799417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd17ca-1709-4c27-8ff5-002fb794d2f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:01.811884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd17ca-1709-4c27-8ff5-002fb794d2f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-58cd17ca-1709-4c27-8ff5-002fb794d2f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:01.821702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:01.822607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:16:01.823425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:01.826453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 207/419] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:01.831663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd17ca-1709-4c27-8ff5-002fb794d2f2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:01.836635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:01.862262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 213/420] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:16:01.887956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feda967-6ce9-4837-b88b-1333e729ea4e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:01.962933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd17ca-1709-4c27-8ff5-002fb794d2f2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:01.994567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dde299-84c0-40bb-9dc3-af509599cfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:01.995281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde299-84c0-40bb-9dc3-af509599cfdd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:01.995514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde299-84c0-40bb-9dc3-af509599cfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:01.995795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dde299-84c0-40bb-9dc3-af509599cfdd None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:01.996656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dde299-84c0-40bb-9dc3-af509599cfdd None admin] RBAC: Adding query filter params (name=member) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:01.996884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dde299-84c0-40bb-9dc3-af509599cfdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:02.002371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dde299-84c0-40bb-9dc3-af509599cfdd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:02.007040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 208/421] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:16:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:02.016591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dde299-84c0-40bb-9dc3-af509599cfdd None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:02.046324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feda967-6ce9-4837-b88b-1333e729ea4e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:02.111353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4179565-ef5e-4a48-a9c8-682c4f4a3313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:02.117198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:02.117446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4179565-ef5e-4a48-a9c8-682c4f4a3313 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:02.117869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4179565-ef5e-4a48-a9c8-682c4f4a3313 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:02.118441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4179565-ef5e-4a48-a9c8-682c4f4a3313 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:02.139634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4179565-ef5e-4a48-a9c8-682c4f4a3313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:02.152855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dde299-84c0-40bb-9dc3-af509599cfdd None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c4179565-ef5e-4a48-a9c8-682c4f4a3313 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:02.156843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:02.157797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:02.158600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 214/422] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:02.165150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4179565-ef5e-4a48-a9c8-682c4f4a3313 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:02.190525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9482f-13fd-4e6e-b2ce-8ad2b346e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:02.191179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9482f-13fd-4e6e-b2ce-8ad2b346e66d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:02.191508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9482f-13fd-4e6e-b2ce-8ad2b346e66d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:02.191784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b9482f-13fd-4e6e-b2ce-8ad2b346e66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:02.221170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:02.312591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4179565-ef5e-4a48-a9c8-682c4f4a3313 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:02.331472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9482f-13fd-4e6e-b2ce-8ad2b346e66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:02.334247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b9482f-13fd-4e6e-b2ce-8ad2b346e66d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:02.377864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc026e-cc01-457d-9609-268c74af4b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:02.378466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc026e-cc01-457d-9609-268c74af4b47 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:02.378751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc026e-cc01-457d-9609-268c74af4b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:02.379022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc026e-cc01-457d-9609-268c74af4b47 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:02.379774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc026e-cc01-457d-9609-268c74af4b47 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:02.380077 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc026e-cc01-457d-9609-268c74af4b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:02.381666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc026e-cc01-457d-9609-268c74af4b47 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:02.401289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 215/423] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:02.409761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc026e-cc01-457d-9609-268c74af4b47 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:02.410343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:02.442378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 209/424] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:16:02.447982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9482f-13fd-4e6e-b2ce-8ad2b346e66d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:02.556067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b9482f-13fd-4e6e-b2ce-8ad2b346e66d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:02.593989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f5edd-fd85-4d5e-8d0a-3a5c8e7ae283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:02.600592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f5edd-fd85-4d5e-8d0a-3a5c8e7ae283 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:02.600592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f5edd-fd85-4d5e-8d0a-3a5c8e7ae283 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:02.600592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f5edd-fd85-4d5e-8d0a-3a5c8e7ae283 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:02.600592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f5edd-fd85-4d5e-8d0a-3a5c8e7ae283 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:02.600592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f5edd-fd85-4d5e-8d0a-3a5c8e7ae283 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:02.600592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 210/425] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:16:02 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:02.609591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f5edd-fd85-4d5e-8d0a-3a5c8e7ae283 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:02.614939 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:02.625196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc026e-cc01-457d-9609-268c74af4b47 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:02.660132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd18ff-e36c-42d4-8a3d-7a974dcfc879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:02.660735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd18ff-e36c-42d4-8a3d-7a974dcfc879 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:02.661017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd18ff-e36c-42d4-8a3d-7a974dcfc879 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:02.661291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd18ff-e36c-42d4-8a3d-7a974dcfc879 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:02.681646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:02.734400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd18ff-e36c-42d4-8a3d-7a974dcfc879 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:02.735865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cd18ff-e36c-42d4-8a3d-7a974dcfc879 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:02.834827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:02.845791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 216/426] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:02.854453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd18ff-e36c-42d4-8a3d-7a974dcfc879 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:02.910759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f5edd-fd85-4d5e-8d0a-3a5c8e7ae283 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:02.963218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd18ff-e36c-42d4-8a3d-7a974dcfc879 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:03.001355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a280b-8c89-40fd-9ae1-15a9e2ff1317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:03.002214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a280b-8c89-40fd-9ae1-15a9e2ff1317 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.002491 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a280b-8c89-40fd-9ae1-15a9e2ff1317 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.002760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a280b-8c89-40fd-9ae1-15a9e2ff1317 None admin] PATH_INFO: `/v3/projects/f8518c8e5e874ff6806e967ca32ffaca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.003943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a280b-8c89-40fd-9ae1-15a9e2ff1317 None admin] RBAC: Authorizing `identity:get_project(project_id=f8518c8e5e874ff6806e967ca32ffaca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:03.005587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085a280b-8c89-40fd-9ae1-15a9e2ff1317 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:03.007856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 217/427] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:16:02 2022] GET /identity/v3/projects/f8518c8e5e874ff6806e967ca32ffaca => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:03.013387 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a280b-8c89-40fd-9ae1-15a9e2ff1317 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:03.041210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab015efa-a1d2-4ca0-8535-aba32f8c0d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:03.042099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015efa-a1d2-4ca0-8535-aba32f8c0d09 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.042370 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015efa-a1d2-4ca0-8535-aba32f8c0d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.042646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab015efa-a1d2-4ca0-8535-aba32f8c0d09 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.043945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab015efa-a1d2-4ca0-8535-aba32f8c0d09 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:03.045456 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab015efa-a1d2-4ca0-8535-aba32f8c0d09 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:03.050028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 211/428] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:16:02 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:03.055673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab015efa-a1d2-4ca0-8535-aba32f8c0d09 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:03.088979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:03.136983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a280b-8c89-40fd-9ae1-15a9e2ff1317 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:03.174921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc6b43-70c4-4539-8316-416dfb7e4e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:03.175699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc6b43-70c4-4539-8316-416dfb7e4e6d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.175983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc6b43-70c4-4539-8316-416dfb7e4e6d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.176261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adc6b43-70c4-4539-8316-416dfb7e4e6d None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.177559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc6b43-70c4-4539-8316-416dfb7e4e6d None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:03.179937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adc6b43-70c4-4539-8316-416dfb7e4e6d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:03.181909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 218/429] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:16:03 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:03.187275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc6b43-70c4-4539-8316-416dfb7e4e6d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:03.244183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:03.247215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab015efa-a1d2-4ca0-8535-aba32f8c0d09 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:03.310483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89555029-1f08-440d-af74-33d9acbd5c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:03.311424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555029-1f08-440d-af74-33d9acbd5c45 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.311893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555029-1f08-440d-af74-33d9acbd5c45 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.312337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89555029-1f08-440d-af74-33d9acbd5c45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.313349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89555029-1f08-440d-af74-33d9acbd5c45 None admin] RBAC: Adding query filter params (group.id=3faeb13a21c24a5c91ae01333e352935, role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:03.313805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89555029-1f08-440d-af74-33d9acbd5c45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:03.315592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89555029-1f08-440d-af74-33d9acbd5c45 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:03.322700 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 212/430] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:16:03 2022] GET /identity/v3/role_assignments?group.id=3faeb13a21c24a5c91ae01333e352935&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 611 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:03.324814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ec80f-88eb-406a-8669-d01e43ff22d2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.325283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ec80f-88eb-406a-8669-d01e43ff22d2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.325836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ec80f-88eb-406a-8669-d01e43ff22d2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.331812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 213/431] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:03.333855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ab6a7-b054-446f-81af-e9d441ab0731 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.334487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ab6a7-b054-446f-81af-e9d441ab0731 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.335115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ab6a7-b054-446f-81af-e9d441ab0731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.336903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adc6b43-70c4-4539-8316-416dfb7e4e6d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:03.353699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5e9ab6a7-b054-446f-81af-e9d441ab0731 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:03.355243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5e9ab6a7-b054-446f-81af-e9d441ab0731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:03.367098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:03.402862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c32438-5814-43c4-a769-f0d900e33661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:03.403717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c32438-5814-43c4-a769-f0d900e33661 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.404379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c32438-5814-43c4-a769-f0d900e33661 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.404379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c32438-5814-43c4-a769-f0d900e33661 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.405280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c32438-5814-43c4-a769-f0d900e33661 None admin] RBAC: Adding query filter params (group.id=3faeb13a21c24a5c91ae01333e352935, role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=f8518c8e5e874ff6806e967ca32ffaca) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:03.405655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c32438-5814-43c4-a769-f0d900e33661 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:03.407230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c32438-5814-43c4-a769-f0d900e33661 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:03.422133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 219/432] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:16:03 2022] GET /identity/v3/role_assignments?group.id=3faeb13a21c24a5c91ae01333e352935&scope.project.id=f8518c8e5e874ff6806e967ca32ffaca&role.id=3e26988f292a493c8351b566b43239e2 => generated 611 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:03.438354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 214/433] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:03.462602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c32438-5814-43c4-a769-f0d900e33661 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:03.538049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4e031-2294-4dd7-94d4-08583b172356 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.538500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4e031-2294-4dd7-94d4-08583b172356 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.538967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf4e031-2294-4dd7-94d4-08583b172356 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.540734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 215/434] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:03.546386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de72d4-f69f-4cf5-b1e8-b578c1a56720 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.546674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de72d4-f69f-4cf5-b1e8-b578c1a56720 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.546960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de72d4-f69f-4cf5-b1e8-b578c1a56720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.577017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-29de72d4-f69f-4cf5-b1e8-b578c1a56720 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:03.578238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-29de72d4-f69f-4cf5-b1e8-b578c1a56720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:03.602852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c32438-5814-43c4-a769-f0d900e33661 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:03.646805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570b22e-f7d2-463c-bb8a-b951c76ce4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:03.649914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570b22e-f7d2-463c-bb8a-b951c76ce4a4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.650444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570b22e-f7d2-463c-bb8a-b951c76ce4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.651202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f570b22e-f7d2-463c-bb8a-b951c76ce4a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.666637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f570b22e-f7d2-463c-bb8a-b951c76ce4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f570b22e-f7d2-463c-bb8a-b951c76ce4a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:03.677316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:03.679142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:16:03.680072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:03.682739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 220/435] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:03.688766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570b22e-f7d2-463c-bb8a-b951c76ce4a4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:03.688913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 216/436] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:16:03.712361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de72d4-f69f-4cf5-b1e8-b578c1a56720 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:03.746513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:03.763017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:03.839886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f570b22e-f7d2-463c-bb8a-b951c76ce4a4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:03.859226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de72d4-f69f-4cf5-b1e8-b578c1a56720 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:03.883212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ac537-fb05-4c93-90f1-267467f8ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:03.883940 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ac537-fb05-4c93-90f1-267467f8ecf2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.884169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ac537-fb05-4c93-90f1-267467f8ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.884433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48ac537-fb05-4c93-90f1-267467f8ecf2 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.885372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ac537-fb05-4c93-90f1-267467f8ecf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:03.885546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ac537-fb05-4c93-90f1-267467f8ecf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:03.886900 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48ac537-fb05-4c93-90f1-267467f8ecf2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:03.895814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 221/437] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:16:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:03.902436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ac537-fb05-4c93-90f1-267467f8ecf2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:03.911555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f799d9-2d9f-44f8-bb36-71942417d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:03.912396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f799d9-2d9f-44f8-bb36-71942417d25c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:03.912737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f799d9-2d9f-44f8-bb36-71942417d25c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:03.913615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f799d9-2d9f-44f8-bb36-71942417d25c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:03.930159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f799d9-2d9f-44f8-bb36-71942417d25c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-91f799d9-2d9f-44f8-bb36-71942417d25c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:03.939181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:03.940055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:16:03.940956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:03.942091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 217/438] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:03.948175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f799d9-2d9f-44f8-bb36-71942417d25c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:04.031079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48ac537-fb05-4c93-90f1-267467f8ecf2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:04.050932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:04.058339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:04.081040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f799d9-2d9f-44f8-bb36-71942417d25c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:04.087942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0e291-abc1-4579-bcd1-4a1e2b95b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:04.088916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0e291-abc1-4579-bcd1-4a1e2b95b6af None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.089255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0e291-abc1-4579-bcd1-4a1e2b95b6af None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.089591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d0e291-abc1-4579-bcd1-4a1e2b95b6af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.124796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131e2c7-8ae7-4dac-807e-0897f6218396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:04.125465 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131e2c7-8ae7-4dac-807e-0897f6218396 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.125744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131e2c7-8ae7-4dac-807e-0897f6218396 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.126018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131e2c7-8ae7-4dac-807e-0897f6218396 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.126762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131e2c7-8ae7-4dac-807e-0897f6218396 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:04.127065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131e2c7-8ae7-4dac-807e-0897f6218396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:04.128626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131e2c7-8ae7-4dac-807e-0897f6218396 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:04.139869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 218/439] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:04.145289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131e2c7-8ae7-4dac-807e-0897f6218396 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:04.173513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0e291-abc1-4579-bcd1-4a1e2b95b6af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:04.176257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d0e291-abc1-4579-bcd1-4a1e2b95b6af None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:04.293546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131e2c7-8ae7-4dac-807e-0897f6218396 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:04.300040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 222/440] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:16:04.306170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0e291-abc1-4579-bcd1-4a1e2b95b6af None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:04.322431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:04.329783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde072d-2306-44ec-9661-79284bbf1c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:04.330864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde072d-2306-44ec-9661-79284bbf1c42 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.331152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde072d-2306-44ec-9661-79284bbf1c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.331611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde072d-2306-44ec-9661-79284bbf1c42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.349132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:04.402889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde072d-2306-44ec-9661-79284bbf1c42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:04.404358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde072d-2306-44ec-9661-79284bbf1c42 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:04.410008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d0e291-abc1-4579-bcd1-4a1e2b95b6af None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:04.442615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ec11f-804c-4c5d-9e87-d4a4b76ecd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:04.443470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ec11f-804c-4c5d-9e87-d4a4b76ecd61 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.443758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ec11f-804c-4c5d-9e87-d4a4b76ecd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.444696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ec11f-804c-4c5d-9e87-d4a4b76ecd61 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.445892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ec11f-804c-4c5d-9e87-d4a4b76ecd61 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:04.447331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ec11f-804c-4c5d-9e87-d4a4b76ecd61 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:04.449079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 223/441] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:16:04 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:04.450258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172c4c9-c621-4e92-9d7d-f2b23e6dc379 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.450538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172c4c9-c621-4e92-9d7d-f2b23e6dc379 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.450821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3172c4c9-c621-4e92-9d7d-f2b23e6dc379 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.455991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 224/442] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:04.456771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172c4c9-c621-4e92-9d7d-f2b23e6dc379 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:04.499281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 219/443] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:16:04.501958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441525-0e59-4bfa-bc9c-c03e00c1df25 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.502251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441525-0e59-4bfa-bc9c-c03e00c1df25 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.502533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9441525-0e59-4bfa-bc9c-c03e00c1df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.518729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a9441525-0e59-4bfa-bc9c-c03e00c1df25 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:04.519914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a9441525-0e59-4bfa-bc9c-c03e00c1df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:04.537896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:04.556302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3172c4c9-c621-4e92-9d7d-f2b23e6dc379 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:04.561686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:04.587153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 220/444] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:04.587997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9441525-0e59-4bfa-bc9c-c03e00c1df25 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:04.600328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ec5da-2fa9-49ab-a445-efa2921d3dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:04.601243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ec5da-2fa9-49ab-a445-efa2921d3dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.601530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ec5da-2fa9-49ab-a445-efa2921d3dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.601812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ec5da-2fa9-49ab-a445-efa2921d3dc3 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.602997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ec5da-2fa9-49ab-a445-efa2921d3dc3 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:04.604439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ec5da-2fa9-49ab-a445-efa2921d3dc3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:04.606396 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 225/445] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:16:04 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:04.611745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ec5da-2fa9-49ab-a445-efa2921d3dc3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:04.690703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9441525-0e59-4bfa-bc9c-c03e00c1df25 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:04.708240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ec5da-2fa9-49ab-a445-efa2921d3dc3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:04.723786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c3f3d-958d-49b1-a4da-47d5bab862d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:04.724703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3f3d-958d-49b1-a4da-47d5bab862d8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.724984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3f3d-958d-49b1-a4da-47d5bab862d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.725282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41c3f3d-958d-49b1-a4da-47d5bab862d8 None admin] PATH_INFO: `/v3/projects/3fb33448368d4b45a3d0f28261a78d5d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.726454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c3f3d-958d-49b1-a4da-47d5bab862d8 None admin] RBAC: Authorizing `identity:get_project(project_id=3fb33448368d4b45a3d0f28261a78d5d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:04.727908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41c3f3d-958d-49b1-a4da-47d5bab862d8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:04.729705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 221/446] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:16:04 2022] GET /identity/v3/projects/3fb33448368d4b45a3d0f28261a78d5d => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:04.730455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c3f3d-958d-49b1-a4da-47d5bab862d8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:04.745856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a1abe-0309-48c0-b26c-5b47d572bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:04.746512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a1abe-0309-48c0-b26c-5b47d572bf8b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.746794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a1abe-0309-48c0-b26c-5b47d572bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.747070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381a1abe-0309-48c0-b26c-5b47d572bf8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.747903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a1abe-0309-48c0-b26c-5b47d572bf8b None admin] RBAC: Adding query filter params (group.id=3faeb13a21c24a5c91ae01333e352935, role.id=511a27be33a74a7c996a7ca5261b55f6, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:04.748212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a1abe-0309-48c0-b26c-5b47d572bf8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:04.749800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381a1abe-0309-48c0-b26c-5b47d572bf8b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:04.755655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 226/447] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:16:04 2022] GET /identity/v3/role_assignments?group.id=3faeb13a21c24a5c91ae01333e352935&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=511a27be33a74a7c996a7ca5261b55f6 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:04.756284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a1abe-0309-48c0-b26c-5b47d572bf8b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:04.772546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:04.786805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:04.848590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41c3f3d-958d-49b1-a4da-47d5bab862d8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:04.872170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381a1abe-0309-48c0-b26c-5b47d572bf8b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:04.887578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318de1bb-706c-4eb3-98d3-e01af149ad6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:04.888398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318de1bb-706c-4eb3-98d3-e01af149ad6f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.888711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318de1bb-706c-4eb3-98d3-e01af149ad6f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.888988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318de1bb-706c-4eb3-98d3-e01af149ad6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.901791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318de1bb-706c-4eb3-98d3-e01af149ad6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-318de1bb-706c-4eb3-98d3-e01af149ad6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:04.909661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:04.910825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:04.911646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 222/448] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:04.917304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318de1bb-706c-4eb3-98d3-e01af149ad6f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:04.918448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e91efd-05f4-4452-a8b9-8511740d14e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:04.919338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e91efd-05f4-4452-a8b9-8511740d14e1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:04.919615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e91efd-05f4-4452-a8b9-8511740d14e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:04.919895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e91efd-05f4-4452-a8b9-8511740d14e1 None admin] PATH_INFO: `/v3/groups/3faeb13a21c24a5c91ae01333e352935` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:04.921173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e91efd-05f4-4452-a8b9-8511740d14e1 None admin] RBAC: Authorizing `identity:get_group(group_id=3faeb13a21c24a5c91ae01333e352935)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:04.922700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e91efd-05f4-4452-a8b9-8511740d14e1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:04.924589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 227/449] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:16:04 2022] GET /identity/v3/groups/3faeb13a21c24a5c91ae01333e352935 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:04.930803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e91efd-05f4-4452-a8b9-8511740d14e1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:05.027081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:05.034887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318de1bb-706c-4eb3-98d3-e01af149ad6f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:05.042232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:05.048486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e91efd-05f4-4452-a8b9-8511740d14e1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:05.076240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6990ec-ce69-4558-b425-6041132b6d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:05.076975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6990ec-ce69-4558-b425-6041132b6d80 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:05.077256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6990ec-ce69-4558-b425-6041132b6d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:05.077531 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6990ec-ce69-4558-b425-6041132b6d80 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:05.078280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6990ec-ce69-4558-b425-6041132b6d80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:05.078587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6990ec-ce69-4558-b425-6041132b6d80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:05.079990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6990ec-ce69-4558-b425-6041132b6d80 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:05.089687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 223/450] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:05.095631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6990ec-ce69-4558-b425-6041132b6d80 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:05.097518 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216aee5-18e7-4934-9fe3-8087a9410de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:05.098556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216aee5-18e7-4934-9fe3-8087a9410de1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:05.098556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216aee5-18e7-4934-9fe3-8087a9410de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:05.098759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216aee5-18e7-4934-9fe3-8087a9410de1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:05.099547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216aee5-18e7-4934-9fe3-8087a9410de1 None admin] RBAC: Adding query filter params (group.id=3faeb13a21c24a5c91ae01333e352935, role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=3fb33448368d4b45a3d0f28261a78d5d) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:05.099861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216aee5-18e7-4934-9fe3-8087a9410de1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:05.102116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216aee5-18e7-4934-9fe3-8087a9410de1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:05.110561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 228/451] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:16:04 2022] GET /identity/v3/role_assignments?group.id=3faeb13a21c24a5c91ae01333e352935&scope.project.id=3fb33448368d4b45a3d0f28261a78d5d&role.id=3e26988f292a493c8351b566b43239e2 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:05.214879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6990ec-ce69-4558-b425-6041132b6d80 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:05.250225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aafec-162c-4604-be1a-56001ef2d097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:05.250892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aafec-162c-4604-be1a-56001ef2d097 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:05.251227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aafec-162c-4604-be1a-56001ef2d097 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:05.251467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aafec-162c-4604-be1a-56001ef2d097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:05.288781 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:05.323224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aafec-162c-4604-be1a-56001ef2d097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:05.325026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91aafec-162c-4604-be1a-56001ef2d097 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:05.430938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 224/452] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:16:05.436453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216aee5-18e7-4934-9fe3-8087a9410de1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:05.538637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216aee5-18e7-4934-9fe3-8087a9410de1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:05.572533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411184-a122-45b4-b9f3-fb85640a9766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:05.573383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411184-a122-45b4-b9f3-fb85640a9766 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:05.573666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411184-a122-45b4-b9f3-fb85640a9766 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:05.573943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45411184-a122-45b4-b9f3-fb85640a9766 None admin] PATH_INFO: `/v3/projects/c4db8d1f990d4445ab6059278607233e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:05.575119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411184-a122-45b4-b9f3-fb85640a9766 None admin] RBAC: Authorizing `identity:get_project(project_id=c4db8d1f990d4445ab6059278607233e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:05.576589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45411184-a122-45b4-b9f3-fb85640a9766 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:05.578272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 229/453] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:16:05 2022] GET /identity/v3/projects/c4db8d1f990d4445ab6059278607233e => generated 344 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:05.583898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aafec-162c-4604-be1a-56001ef2d097 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:05.647955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:05.681032 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aafec-162c-4604-be1a-56001ef2d097 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:05.714385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14779bd-0f0a-4762-82a5-e86ee4b96707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:05.715239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14779bd-0f0a-4762-82a5-e86ee4b96707 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:05.715519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14779bd-0f0a-4762-82a5-e86ee4b96707 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:05.715788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14779bd-0f0a-4762-82a5-e86ee4b96707 None admin] PATH_INFO: `/v3/groups/e3c4f97a4faa4fc79b1e2481cd77e580` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:05.717236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14779bd-0f0a-4762-82a5-e86ee4b96707 None admin] RBAC: Authorizing `identity:get_group(group_id=e3c4f97a4faa4fc79b1e2481cd77e580)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:05.718687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14779bd-0f0a-4762-82a5-e86ee4b96707 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:05.720286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 225/454] 10.222.0.24 () {56 vars in 1180 bytes} [Wed May 25 07:16:05 2022] GET /identity/v3/groups/e3c4f97a4faa4fc79b1e2481cd77e580 => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:05.726889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411184-a122-45b4-b9f3-fb85640a9766 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:05.741933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:05.822571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45411184-a122-45b4-b9f3-fb85640a9766 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:05.855122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4a18a-50a5-4bef-b5f6-0ee5d61323d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:05.855755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4a18a-50a5-4bef-b5f6-0ee5d61323d8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:05.856032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4a18a-50a5-4bef-b5f6-0ee5d61323d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:05.856305 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4a18a-50a5-4bef-b5f6-0ee5d61323d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:05.857143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4a18a-50a5-4bef-b5f6-0ee5d61323d8 None admin] RBAC: Adding query filter params (group.id=e3c4f97a4faa4fc79b1e2481cd77e580, role.id=7c09d078126441909df0a46212ffea63, scope.project.id=c4db8d1f990d4445ab6059278607233e) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:05.857452 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4a18a-50a5-4bef-b5f6-0ee5d61323d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:05.858857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4a18a-50a5-4bef-b5f6-0ee5d61323d8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:05.864417 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 230/455] 10.222.0.24 () {56 vars in 1376 bytes} [Wed May 25 07:16:05 2022] GET /identity/v3/role_assignments?group.id=e3c4f97a4faa4fc79b1e2481cd77e580&scope.project.id=c4db8d1f990d4445ab6059278607233e&role.id=7c09d078126441909df0a46212ffea63 => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:08.612803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9190ae-a568-4180-8bf9-db5ac739d2c2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:08.613304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9190ae-a568-4180-8bf9-db5ac739d2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:08.613379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9190ae-a568-4180-8bf9-db5ac739d2c2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:08.614957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 226/456] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:08.620217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a855a9-12a8-4fbb-bfb8-cd47fb0380db None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:08.620673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a855a9-12a8-4fbb-bfb8-cd47fb0380db None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:08.620842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a855a9-12a8-4fbb-bfb8-cd47fb0380db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:08.645733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-01a855a9-12a8-4fbb-bfb8-cd47fb0380db None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:08.647418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-01a855a9-12a8-4fbb-bfb8-cd47fb0380db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:08.699364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be1efb-089a-4b63-9259-07cd31154e8a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:08.700085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be1efb-089a-4b63-9259-07cd31154e8a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:08.700601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be1efb-089a-4b63-9259-07cd31154e8a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:08.703502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 227/457] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:16:08.707850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a215-a627-498c-ad3a-617ee69db5f0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:08.708374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a215-a627-498c-ad3a-617ee69db5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:08.708968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077a215-a627-498c-ad3a-617ee69db5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:08.727241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8077a215-a627-498c-ad3a-617ee69db5f0 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:08.728937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8077a215-a627-498c-ad3a-617ee69db5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:08.747946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 231/458] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:08.794058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a855a9-12a8-4fbb-bfb8-cd47fb0380db None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:08.802585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:08.825095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 228/459] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:16:08.832173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8869-7c9a-4f6c-9807-8bb027522f7b None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:08.832673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8869-7c9a-4f6c-9807-8bb027522f7b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:08.833091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a8869-7c9a-4f6c-9807-8bb027522f7b None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:08.834694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 229/460] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:08.840277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8c514-85a8-4944-98d2-ee2477c99051 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:08.840862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8c514-85a8-4944-98d2-ee2477c99051 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:08.842484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8c514-85a8-4944-98d2-ee2477c99051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:08.860202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c8a8c514-85a8-4944-98d2-ee2477c99051 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:08.861710 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c8a8c514-85a8-4944-98d2-ee2477c99051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:08.934057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a855a9-12a8-4fbb-bfb8-cd47fb0380db None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:08.935076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 230/461] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:16:08.936191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8c514-85a8-4944-98d2-ee2477c99051 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:08.940676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:08.989930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea278a25-aa8c-440f-b79d-57c75673ce44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:08.990736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea278a25-aa8c-440f-b79d-57c75673ce44 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:08.991021 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea278a25-aa8c-440f-b79d-57c75673ce44 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:08.991389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea278a25-aa8c-440f-b79d-57c75673ce44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.002553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea278a25-aa8c-440f-b79d-57c75673ce44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:09.004037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea278a25-aa8c-440f-b79d-57c75673ce44 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ea278a25-aa8c-440f-b79d-57c75673ce44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:09.029541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:09.030450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:09.031913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:09.031913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:09.031913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:09.031913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:09.031913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 232/462] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:09.032217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea278a25-aa8c-440f-b79d-57c75673ce44 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:09.074818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8c514-85a8-4944-98d2-ee2477c99051 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:09.107531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:09.111818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e56f82-8242-45be-a282-f6571a1f9cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:09.112600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e56f82-8242-45be-a282-f6571a1f9cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.112883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e56f82-8242-45be-a282-f6571a1f9cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.113158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e56f82-8242-45be-a282-f6571a1f9cd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.125124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e56f82-8242-45be-a282-f6571a1f9cd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:09.126634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e56f82-8242-45be-a282-f6571a1f9cd1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a0e56f82-8242-45be-a282-f6571a1f9cd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:09.147894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:09.148850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:09.150177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:09.150177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:09.150177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:09.150177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:09.150177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 231/463] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:09.154967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e56f82-8242-45be-a282-f6571a1f9cd1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:09.160757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea278a25-aa8c-440f-b79d-57c75673ce44 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:09.205620 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88610433-9d3d-4a47-b21f-54ef6b7ff562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:09.205952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:09.206792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88610433-9d3d-4a47-b21f-54ef6b7ff562 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.207085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88610433-9d3d-4a47-b21f-54ef6b7ff562 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.207516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88610433-9d3d-4a47-b21f-54ef6b7ff562 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.222027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88610433-9d3d-4a47-b21f-54ef6b7ff562 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:09.224279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88610433-9d3d-4a47-b21f-54ef6b7ff562 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-88610433-9d3d-4a47-b21f-54ef6b7ff562 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:09.248913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:09.250925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:09.253044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:09.253044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:09.253044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:09.253044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:09.253044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 233/464] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:09.253669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88610433-9d3d-4a47-b21f-54ef6b7ff562 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:09.272876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e56f82-8242-45be-a282-f6571a1f9cd1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:09.318104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459904-7711-407b-ba1c-d72399c60895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:09.318989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459904-7711-407b-ba1c-d72399c60895 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.319690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459904-7711-407b-ba1c-d72399c60895 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.320036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85459904-7711-407b-ba1c-d72399c60895 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.321398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85459904-7711-407b-ba1c-d72399c60895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:09.321716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85459904-7711-407b-ba1c-d72399c60895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:09.323105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85459904-7711-407b-ba1c-d72399c60895 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:09.338960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 232/465] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:09.339922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459904-7711-407b-ba1c-d72399c60895 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:09.367047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88610433-9d3d-4a47-b21f-54ef6b7ff562 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:09.379188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:09.404499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923c7c2-ea1f-46c6-b162-141b3013713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:09.405198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923c7c2-ea1f-46c6-b162-141b3013713b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.405484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923c7c2-ea1f-46c6-b162-141b3013713b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.405770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9923c7c2-ea1f-46c6-b162-141b3013713b None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.406509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923c7c2-ea1f-46c6-b162-141b3013713b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:09.406820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923c7c2-ea1f-46c6-b162-141b3013713b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:09.408316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9923c7c2-ea1f-46c6-b162-141b3013713b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:09.421995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 234/466] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:09.422601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923c7c2-ea1f-46c6-b162-141b3013713b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:09.454511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85459904-7711-407b-ba1c-d72399c60895 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:09.461897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:09.489858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71540e0-8ee9-4bfe-9fe4-825e01ad7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:09.490549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71540e0-8ee9-4bfe-9fe4-825e01ad7529 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.491028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71540e0-8ee9-4bfe-9fe4-825e01ad7529 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.491309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71540e0-8ee9-4bfe-9fe4-825e01ad7529 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.492139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71540e0-8ee9-4bfe-9fe4-825e01ad7529 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:09.492467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71540e0-8ee9-4bfe-9fe4-825e01ad7529 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:09.493937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71540e0-8ee9-4bfe-9fe4-825e01ad7529 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:09.507669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 233/467] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:09.509098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690563-8550-4729-ad6f-54986131c9a6 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.509388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690563-8550-4729-ad6f-54986131c9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.509666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20690563-8550-4729-ad6f-54986131c9a6 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.511079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 234/468] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:09.511602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20690563-8550-4729-ad6f-54986131c9a6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:09.537368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9923c7c2-ea1f-46c6-b162-141b3013713b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:09.573171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafa934-10c5-4cb8-9beb-a7c83168271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:09.573903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa934-10c5-4cb8-9beb-a7c83168271e None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.574188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa934-10c5-4cb8-9beb-a7c83168271e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.574472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddafa934-10c5-4cb8-9beb-a7c83168271e None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.575226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafa934-10c5-4cb8-9beb-a7c83168271e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:09.576726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddafa934-10c5-4cb8-9beb-a7c83168271e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:09.627303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20690563-8550-4729-ad6f-54986131c9a6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:09.664696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ec26f-8b85-4ad7-94c2-12ed9b33f453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:09.665750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ec26f-8b85-4ad7-94c2-12ed9b33f453 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.665901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 235/469] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:16:09 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:09.666724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafa934-10c5-4cb8-9beb-a7c83168271e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:09.667232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ec26f-8b85-4ad7-94c2-12ed9b33f453 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.667731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ec26f-8b85-4ad7-94c2-12ed9b33f453 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.668683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ec26f-8b85-4ad7-94c2-12ed9b33f453 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:09.670766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ec26f-8b85-4ad7-94c2-12ed9b33f453 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:09.701615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:09.777070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 235/470] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:16:09 2022] POST /identity/v3/users => generated 248 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:09.778536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3fdc6-6cc8-470c-b1f5-670d457637b2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.778900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3fdc6-6cc8-470c-b1f5-670d457637b2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.779477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc3fdc6-6cc8-470c-b1f5-670d457637b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.790043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddafa934-10c5-4cb8-9beb-a7c83168271e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:09.825750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cbc3fdc6-6cc8-470c-b1f5-670d457637b2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:09.827016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cbc3fdc6-6cc8-470c-b1f5-670d457637b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:09.835613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a600a5-a78c-4d3a-be8a-872b45dcd6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:09.836790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a600a5-a78c-4d3a-be8a-872b45dcd6d6 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:09.837246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a600a5-a78c-4d3a-be8a-872b45dcd6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:09.837716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a600a5-a78c-4d3a-be8a-872b45dcd6d6 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:09.838625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a600a5-a78c-4d3a-be8a-872b45dcd6d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:09.840723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a600a5-a78c-4d3a-be8a-872b45dcd6d6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:09.866694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:09.930532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 236/471] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:09.958770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 236/472] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:16:09 2022] POST /identity/v3/users => generated 246 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:09.962727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3fdc6-6cc8-470c-b1f5-670d457637b2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:10.091249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc3fdc6-6cc8-470c-b1f5-670d457637b2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:10.105894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e582-ad11-459a-878a-b349bf733d80 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:10.106188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e582-ad11-459a-878a-b349bf733d80 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:10.106490 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872e582-ad11-459a-878a-b349bf733d80 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:10.109053 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 237/473] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:10.113247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c2d4-6988-46fb-907a-f7f71322b53d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:10.113533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c2d4-6988-46fb-907a-f7f71322b53d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:10.113814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812c2d4-6988-46fb-907a-f7f71322b53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:10.138074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40effec8-3296-41aa-9baa-1f8fb799d0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:10.138310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0812c2d4-6988-46fb-907a-f7f71322b53d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:10.139340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40effec8-3296-41aa-9baa-1f8fb799d0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:10.139520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0812c2d4-6988-46fb-907a-f7f71322b53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:10.139959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40effec8-3296-41aa-9baa-1f8fb799d0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:10.140441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40effec8-3296-41aa-9baa-1f8fb799d0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:10.156015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40effec8-3296-41aa-9baa-1f8fb799d0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:10.158128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40effec8-3296-41aa-9baa-1f8fb799d0a8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-40effec8-3296-41aa-9baa-1f8fb799d0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:10.187963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:10.188922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:10.189762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:10.189762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:10.189762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:10.189762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:10.189762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 237/474] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:10.197110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40effec8-3296-41aa-9baa-1f8fb799d0a8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:10.201815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:10.248410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 238/475] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:10.273003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c2d4-6988-46fb-907a-f7f71322b53d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:10.299652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:10.331976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40effec8-3296-41aa-9baa-1f8fb799d0a8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:10.372412 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46f4ff-8085-404c-91ca-848854cd87e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:10.373111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46f4ff-8085-404c-91ca-848854cd87e3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:10.373400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46f4ff-8085-404c-91ca-848854cd87e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:10.373677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e46f4ff-8085-404c-91ca-848854cd87e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:10.374407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46f4ff-8085-404c-91ca-848854cd87e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:10.374717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46f4ff-8085-404c-91ca-848854cd87e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:10.376101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e46f4ff-8085-404c-91ca-848854cd87e3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:10.390635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 238/476] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:10.395772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46f4ff-8085-404c-91ca-848854cd87e3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:10.398267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812c2d4-6988-46fb-907a-f7f71322b53d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:10.437419 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:10.438182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:10.438442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:10.438725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:10.439517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:10.440956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:10.465516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:10.499759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.sql.core [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 07:16:10.499759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 07:16:10.499759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [parameters: {'id': '3880eeb97c324ed1819e02a91a5b0de6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 07:16:10.499759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80335) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 07:16:10.504244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e46f4ff-8085-404c-91ca-848854cd87e3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application conn.query(q) May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result.read() May 25 07:16:10.532702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return ref.to_dict() May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:16:10.533616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application next(self.gen) May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application yield resource May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application next(self.gen) May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.session.rollback() May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.force_reraise() May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise self.value May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application session.commit() May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 07:16:10.534979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._prepare_impl() May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.session.flush() May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._flush(objects) May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application compat.raise_( May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application flush_context.execute() May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rec.execute(self) May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 07:16:10.535827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:16:10.536738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application conn.query(q) May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result.read() May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:16:10.538488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [parameters: {'id': '3880eeb97c324ed1819e02a91a5b0de6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:10.540407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 25 07:16:10.546011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:10.548043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 239/477] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 07:16:10 2022] POST /identity/v3/roles => generated 144 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:10.548043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:10.548303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c226e70-2c75-4458-9608-f030ce6f20ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:10.548303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c226e70-2c75-4458-9608-f030ce6f20ba None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:10.548303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c226e70-2c75-4458-9608-f030ce6f20ba None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:10.548303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c226e70-2c75-4458-9608-f030ce6f20ba None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:10.548889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c226e70-2c75-4458-9608-f030ce6f20ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:10.552499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c226e70-2c75-4458-9608-f030ce6f20ba None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:10.649636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:10.660436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 239/478] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:16:10 2022] POST /identity/v3/users => generated 249 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:16:10.691035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748e361-156e-4e24-b1f4-013b3e469249 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:10.746782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968ccff-38d0-49d2-b7a5-21948fb5e20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:10.747694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ccff-38d0-49d2-b7a5-21948fb5e20f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:10.747978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ccff-38d0-49d2-b7a5-21948fb5e20f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:10.748250 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968ccff-38d0-49d2-b7a5-21948fb5e20f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:10.769183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968ccff-38d0-49d2-b7a5-21948fb5e20f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a968ccff-38d0-49d2-b7a5-21948fb5e20f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:10.777886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:10.780158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:10.782162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 240/479] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:10.788519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c226e70-2c75-4458-9608-f030ce6f20ba None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:10.934693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c226e70-2c75-4458-9608-f030ce6f20ba None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:10.959045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:10.976931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640cb2f9-63dc-4218-9d23-11f8963ce0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:10.977620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cb2f9-63dc-4218-9d23-11f8963ce0ee None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:10.977906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cb2f9-63dc-4218-9d23-11f8963ce0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:10.978189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640cb2f9-63dc-4218-9d23-11f8963ce0ee None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:10.979031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cb2f9-63dc-4218-9d23-11f8963ce0ee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:10.979346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cb2f9-63dc-4218-9d23-11f8963ce0ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:10.980764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640cb2f9-63dc-4218-9d23-11f8963ce0ee None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:10.992558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 240/480] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:12.466413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65865a-eec9-4b56-afb8-82c59e941622 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:12.467181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65865a-eec9-4b56-afb8-82c59e941622 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:12.467257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f65865a-eec9-4b56-afb8-82c59e941622 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:12.468894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 241/481] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:12.473787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eecefa-3cb0-4f80-8c23-510b1d9e60a0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:12.474245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eecefa-3cb0-4f80-8c23-510b1d9e60a0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:12.474438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eecefa-3cb0-4f80-8c23-510b1d9e60a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:12.501503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c8eecefa-3cb0-4f80-8c23-510b1d9e60a0 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:12.502731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c8eecefa-3cb0-4f80-8c23-510b1d9e60a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:12.597456 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 241/482] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:12.645978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65865a-eec9-4b56-afb8-82c59e941622 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:12.782204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f65865a-eec9-4b56-afb8-82c59e941622 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:12.799623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149ccb-221d-4ad8-8686-224b13772c29 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:12.799944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149ccb-221d-4ad8-8686-224b13772c29 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:12.800192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6149ccb-221d-4ad8-8686-224b13772c29 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:12.802283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 242/483] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:16:12.807720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aac706-db6b-4bef-89c1-6cfe2dfd4c9d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:12.808008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aac706-db6b-4bef-89c1-6cfe2dfd4c9d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:12.808290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aac706-db6b-4bef-89c1-6cfe2dfd4c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:12.838971 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-57aac706-db6b-4bef-89c1-6cfe2dfd4c9d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:12.840214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-57aac706-db6b-4bef-89c1-6cfe2dfd4c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:12.861983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e8ff0-74f1-4ab6-8c24-808b002daa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:12.862824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8ff0-74f1-4ab6-8c24-808b002daa04 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:12.863109 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8ff0-74f1-4ab6-8c24-808b002daa04 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:12.863388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e8ff0-74f1-4ab6-8c24-808b002daa04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:12.869791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:12.888866 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e8ff0-74f1-4ab6-8c24-808b002daa04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8b9e8ff0-74f1-4ab6-8c24-808b002daa04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:12.901180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:12.908005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:12.908835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 242/484] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:12.910832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e8ff0-74f1-4ab6-8c24-808b002daa04 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:12.989143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 243/485] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:13.048842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aac706-db6b-4bef-89c1-6cfe2dfd4c9d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:13.060494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e8ff0-74f1-4ab6-8c24-808b002daa04 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:13.102201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d5cb9-77df-4267-923d-7ab110c78f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:13.102881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5cb9-77df-4267-923d-7ab110c78f82 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.103167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5cb9-77df-4267-923d-7ab110c78f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.103450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d5cb9-77df-4267-923d-7ab110c78f82 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.104820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d5cb9-77df-4267-923d-7ab110c78f82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:13.105145 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d5cb9-77df-4267-923d-7ab110c78f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:13.106535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d5cb9-77df-4267-923d-7ab110c78f82 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:13.109184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:13.120550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 243/486] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:13.124622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93a0f-56ef-4e61-8479-ec09d7ae587c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.124622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93a0f-56ef-4e61-8479-ec09d7ae587c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.124622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df93a0f-56ef-4e61-8479-ec09d7ae587c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.124622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 244/487] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:13.129121 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df93a0f-56ef-4e61-8479-ec09d7ae587c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:13.180698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aac706-db6b-4bef-89c1-6cfe2dfd4c9d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:13.213755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:13.220656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d8fc-7b6d-493e-96d2-7004ff8b1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:13.221860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d8fc-7b6d-493e-96d2-7004ff8b1c54 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.222337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d8fc-7b6d-493e-96d2-7004ff8b1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.222803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d8fc-7b6d-493e-96d2-7004ff8b1c54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.238205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2570d8fc-7b6d-493e-96d2-7004ff8b1c54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2570d8fc-7b6d-493e-96d2-7004ff8b1c54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:13.246673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:13.247594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:13.248395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:13.256763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 244/488] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:13.258910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657b876-a95a-4471-812d-a3309ffcd397 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.259398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657b876-a95a-4471-812d-a3309ffcd397 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.259846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5657b876-a95a-4471-812d-a3309ffcd397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.265473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df93a0f-56ef-4e61-8479-ec09d7ae587c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:13.279520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5657b876-a95a-4471-812d-a3309ffcd397 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:13.281155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5657b876-a95a-4471-812d-a3309ffcd397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:13.312763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0dfea-672b-4beb-ac16-d8293911d122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:13.313902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0dfea-672b-4beb-ac16-d8293911d122 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.314465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0dfea-672b-4beb-ac16-d8293911d122 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.314939 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b0dfea-672b-4beb-ac16-d8293911d122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.327756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0dfea-672b-4beb-ac16-d8293911d122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:13.329591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b0dfea-672b-4beb-ac16-d8293911d122 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f2b0dfea-672b-4beb-ac16-d8293911d122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:13.348359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:13.349314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:13.350953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:13.350953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:13.350953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:13.350953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:13.357694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 245/489] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:13.358793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0dfea-672b-4beb-ac16-d8293911d122 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:13.370112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 245/490] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:13.370893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657b876-a95a-4471-812d-a3309ffcd397 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:13.409163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:13.501144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b0dfea-672b-4beb-ac16-d8293911d122 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:13.511317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5657b876-a95a-4471-812d-a3309ffcd397 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:13.516162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:13.541874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087d575-57d5-4607-a1a6-1e835c8b9124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:13.542916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087d575-57d5-4607-a1a6-1e835c8b9124 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.543427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087d575-57d5-4607-a1a6-1e835c8b9124 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.543929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2087d575-57d5-4607-a1a6-1e835c8b9124 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.544980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087d575-57d5-4607-a1a6-1e835c8b9124 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:13.545485 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087d575-57d5-4607-a1a6-1e835c8b9124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:13.547105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2087d575-57d5-4607-a1a6-1e835c8b9124 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:13.561056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 246/491] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:13.562242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087d575-57d5-4607-a1a6-1e835c8b9124 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:13.605373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76863a3a-c8e6-4e59-b933-afd0e37de9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:13.606053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76863a3a-c8e6-4e59-b933-afd0e37de9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.606338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76863a3a-c8e6-4e59-b933-afd0e37de9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.606615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76863a3a-c8e6-4e59-b933-afd0e37de9d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.607354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76863a3a-c8e6-4e59-b933-afd0e37de9d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:13.607665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76863a3a-c8e6-4e59-b933-afd0e37de9d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:13.610292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76863a3a-c8e6-4e59-b933-afd0e37de9d4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:13.631073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 246/492] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:13.631073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76863a3a-c8e6-4e59-b933-afd0e37de9d4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:13.700828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2087d575-57d5-4607-a1a6-1e835c8b9124 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:13.734205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:13.741611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376394ad-5e25-44fc-bb0e-79acc21574f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:13.742407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376394ad-5e25-44fc-bb0e-79acc21574f2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.742687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376394ad-5e25-44fc-bb0e-79acc21574f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.742957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376394ad-5e25-44fc-bb0e-79acc21574f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.743941 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76863a3a-c8e6-4e59-b933-afd0e37de9d4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:13.753932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376394ad-5e25-44fc-bb0e-79acc21574f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-376394ad-5e25-44fc-bb0e-79acc21574f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:13.764600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:13.765535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:13.766342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 247/493] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:13.767682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376394ad-5e25-44fc-bb0e-79acc21574f2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:13.783558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74cb986-e9e3-4462-bc6a-eb1d664b3833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:13.784699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cb986-e9e3-4462-bc6a-eb1d664b3833 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.785189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cb986-e9e3-4462-bc6a-eb1d664b3833 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.785693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cb986-e9e3-4462-bc6a-eb1d664b3833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.796733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cb986-e9e3-4462-bc6a-eb1d664b3833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:13.798229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74cb986-e9e3-4462-bc6a-eb1d664b3833 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:13.799388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f74cb986-e9e3-4462-bc6a-eb1d664b3833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:13.816045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:13.816969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:13.817818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:13.817818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:13.817818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:13.817818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:13.817818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 247/494] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:13.819196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da67d9-3ef7-49a0-b8d6-f38292ad1cc5 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.819714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da67d9-3ef7-49a0-b8d6-f38292ad1cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.819914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51da67d9-3ef7-49a0-b8d6-f38292ad1cc5 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.824583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 248/495] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:13.824583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da67d9-3ef7-49a0-b8d6-f38292ad1cc5 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:13.879856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376394ad-5e25-44fc-bb0e-79acc21574f2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:13.914281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cded401-f280-41dd-b238-a321e87015fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:13.915072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded401-f280-41dd-b238-a321e87015fd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.915353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded401-f280-41dd-b238-a321e87015fd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.915625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cded401-f280-41dd-b238-a321e87015fd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.922609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cded401-f280-41dd-b238-a321e87015fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:13.924079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cded401-f280-41dd-b238-a321e87015fd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:13.928809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51da67d9-3ef7-49a0-b8d6-f38292ad1cc5 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0cded401-f280-41dd-b238-a321e87015fd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:13.939983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:13.940962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:13.941875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 248/496] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:13.942442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cded401-f280-41dd-b238-a321e87015fd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:13.964064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165f087-1331-4609-bb3a-495b68db5901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:13.964989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165f087-1331-4609-bb3a-495b68db5901 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.965277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165f087-1331-4609-bb3a-495b68db5901 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.965557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165f087-1331-4609-bb3a-495b68db5901 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.966300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165f087-1331-4609-bb3a-495b68db5901 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:13.966854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165f087-1331-4609-bb3a-495b68db5901 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:13.968238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165f087-1331-4609-bb3a-495b68db5901 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:13.976536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 249/497] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:13.977716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d31bc-b3a6-45bb-89d3-59a9593f8d2b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:13.978006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d31bc-b3a6-45bb-89d3-59a9593f8d2b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:13.978285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d31bc-b3a6-45bb-89d3-59a9593f8d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:13.989222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:13.995351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5f0d31bc-b3a6-45bb-89d3-59a9593f8d2b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:14.000306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5f0d31bc-b3a6-45bb-89d3-59a9593f8d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:14.040451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:14.048845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cded401-f280-41dd-b238-a321e87015fd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.062639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 250/498] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:14.064238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5592ec-e88f-4fa5-a840-94723573fece None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.064705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5592ec-e88f-4fa5-a840-94723573fece None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.064980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5592ec-e88f-4fa5-a840-94723573fece None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.070419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 251/499] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:14.070419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5592ec-e88f-4fa5-a840-94723573fece None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.089930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81653f-066c-42a5-91db-1f9650facc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.090594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81653f-066c-42a5-91db-1f9650facc3b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.090876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81653f-066c-42a5-91db-1f9650facc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.091151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81653f-066c-42a5-91db-1f9650facc3b None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.092137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81653f-066c-42a5-91db-1f9650facc3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:14.092448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81653f-066c-42a5-91db-1f9650facc3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:14.093859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81653f-066c-42a5-91db-1f9650facc3b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:14.105726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 249/500] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:14.106523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81653f-066c-42a5-91db-1f9650facc3b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.181835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5592ec-e88f-4fa5-a840-94723573fece None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.203545 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81653f-066c-42a5-91db-1f9650facc3b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.215090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d1bf3-9456-4759-8808-99f095512ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.215804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1bf3-9456-4759-8808-99f095512ffb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.216083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1bf3-9456-4759-8808-99f095512ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.216354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d1bf3-9456-4759-8808-99f095512ffb None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.217484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d1bf3-9456-4759-8808-99f095512ffb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:14.217786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d1bf3-9456-4759-8808-99f095512ffb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:14.219240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d1bf3-9456-4759-8808-99f095512ffb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:14.230620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:14.237697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af91c0c-aa16-4cba-b661-3249aa1492e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.238651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91c0c-aa16-4cba-b661-3249aa1492e8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.238928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91c0c-aa16-4cba-b661-3249aa1492e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.239196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af91c0c-aa16-4cba-b661-3249aa1492e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.250581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91c0c-aa16-4cba-b661-3249aa1492e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:14.252117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af91c0c-aa16-4cba-b661-3249aa1492e8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:14.256681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 252/501] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:14.258021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0853-70bd-454e-b017-3c92a40ee979 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.258312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0853-70bd-454e-b017-3c92a40ee979 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.258608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1a0853-70bd-454e-b017-3c92a40ee979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8af91c0c-aa16-4cba-b661-3249aa1492e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:14.272574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:14.273665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:14.279176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:14.279176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:14.279176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:14.279176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:14.279176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 250/502] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:14.279176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af91c0c-aa16-4cba-b661-3249aa1492e8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.279581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7f1a0853-70bd-454e-b017-3c92a40ee979 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:14.279581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7f1a0853-70bd-454e-b017-3c92a40ee979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:14.280978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:14.341980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 253/503] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:14.342812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0853-70bd-454e-b017-3c92a40ee979 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.382329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af91c0c-aa16-4cba-b661-3249aa1492e8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.416936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9e56c-0995-416a-8f87-586c51232e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.417720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e56c-0995-416a-8f87-586c51232e55 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.418003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e56c-0995-416a-8f87-586c51232e55 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.418279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c9e56c-0995-416a-8f87-586c51232e55 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.428087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c9e56c-0995-416a-8f87-586c51232e55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f1c9e56c-0995-416a-8f87-586c51232e55 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:14.435840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:14.436964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 251/504] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:14.437758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9e56c-0995-416a-8f87-586c51232e55 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.438512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1a0853-70bd-454e-b017-3c92a40ee979 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.463151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:14.473729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd336-7fd0-4319-b21f-2eb9b064a17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.474529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd336-7fd0-4319-b21f-2eb9b064a17b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.486514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd336-7fd0-4319-b21f-2eb9b064a17b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.486514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edbd336-7fd0-4319-b21f-2eb9b064a17b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.486514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbd336-7fd0-4319-b21f-2eb9b064a17b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:14.486514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edbd336-7fd0-4319-b21f-2eb9b064a17b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6edbd336-7fd0-4319-b21f-2eb9b064a17b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:14.499954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:14.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:14.501886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 254/505] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:14.502683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd336-7fd0-4319-b21f-2eb9b064a17b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.507219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:14.545690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c9e56c-0995-416a-8f87-586c51232e55 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.577893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10a542-615d-4472-9af0-df230c4878a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.578536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10a542-615d-4472-9af0-df230c4878a3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.578822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10a542-615d-4472-9af0-df230c4878a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.579097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10a542-615d-4472-9af0-df230c4878a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.605077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edbd336-7fd0-4319-b21f-2eb9b064a17b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.637247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf6fcb-2f55-4caf-bc56-66d4ddf6087b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.637895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf6fcb-2f55-4caf-bc56-66d4ddf6087b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.638171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf6fcb-2f55-4caf-bc56-66d4ddf6087b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.638440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbf6fcb-2f55-4caf-bc56-66d4ddf6087b None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.639180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf6fcb-2f55-4caf-bc56-66d4ddf6087b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:14.639482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf6fcb-2f55-4caf-bc56-66d4ddf6087b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:14.640893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbf6fcb-2f55-4caf-bc56-66d4ddf6087b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:14.647372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10a542-615d-4472-9af0-df230c4878a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:14.648866 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a10a542-615d-4472-9af0-df230c4878a3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:14.652676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 255/506] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:14.653449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf6fcb-2f55-4caf-bc56-66d4ddf6087b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.698985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:14.709765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:14.747683 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 252/507] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:14.748544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10a542-615d-4472-9af0-df230c4878a3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.752817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbf6fcb-2f55-4caf-bc56-66d4ddf6087b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.785390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8ff70-f753-486e-beea-d4f36ca94c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.786173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8ff70-f753-486e-beea-d4f36ca94c61 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.786453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8ff70-f753-486e-beea-d4f36ca94c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.786724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db8ff70-f753-486e-beea-d4f36ca94c61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.797752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8ff70-f753-486e-beea-d4f36ca94c61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:14.799215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db8ff70-f753-486e-beea-d4f36ca94c61 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2db8ff70-f753-486e-beea-d4f36ca94c61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:14.817582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:14.818641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:14.820074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:14.820074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:14.820074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:14.820074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:14.820074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 256/508] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:14.820423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8ff70-f753-486e-beea-d4f36ca94c61 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.853406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a10a542-615d-4472-9af0-df230c4878a3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.887411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fcf37-8e0b-491c-a8da-098a0ddd8df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.888072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fcf37-8e0b-491c-a8da-098a0ddd8df2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.888356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fcf37-8e0b-491c-a8da-098a0ddd8df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.888661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143fcf37-8e0b-491c-a8da-098a0ddd8df2 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.889406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fcf37-8e0b-491c-a8da-098a0ddd8df2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:14.889710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fcf37-8e0b-491c-a8da-098a0ddd8df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:14.891076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143fcf37-8e0b-491c-a8da-098a0ddd8df2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:14.901730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 253/509] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:14.902632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fcf37-8e0b-491c-a8da-098a0ddd8df2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:14.914577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:14.920193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db8ff70-f753-486e-beea-d4f36ca94c61 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:14.931444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:14.953517 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b3b53-2d56-4eed-b404-e0ba3030f140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:14.954119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b3b53-2d56-4eed-b404-e0ba3030f140 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:14.954399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b3b53-2d56-4eed-b404-e0ba3030f140 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:14.954672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b3b53-2d56-4eed-b404-e0ba3030f140 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:14.955510 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b3b53-2d56-4eed-b404-e0ba3030f140 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:14.955815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b3b53-2d56-4eed-b404-e0ba3030f140 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:14.957288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b3b53-2d56-4eed-b404-e0ba3030f140 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:14.975490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 257/510] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:14.976286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b3b53-2d56-4eed-b404-e0ba3030f140 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.005143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143fcf37-8e0b-491c-a8da-098a0ddd8df2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.039520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14082-074c-4e89-ba94-59b4981949c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.040315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14082-074c-4e89-ba94-59b4981949c5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.040634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14082-074c-4e89-ba94-59b4981949c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.040921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f14082-074c-4e89-ba94-59b4981949c5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.048043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f14082-074c-4e89-ba94-59b4981949c5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.049534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f14082-074c-4e89-ba94-59b4981949c5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e2f14082-074c-4e89-ba94-59b4981949c5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:15.063772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:15.064783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 254/511] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:15.065916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14082-074c-4e89-ba94-59b4981949c5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.075149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b3b53-2d56-4eed-b404-e0ba3030f140 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.108317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156a783-0bca-40be-a00e-698cff59a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.109131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a783-0bca-40be-a00e-698cff59a85e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.109419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a783-0bca-40be-a00e-698cff59a85e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.109692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156a783-0bca-40be-a00e-698cff59a85e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.120311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156a783-0bca-40be-a00e-698cff59a85e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.121795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156a783-0bca-40be-a00e-698cff59a85e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-4156a783-0bca-40be-a00e-698cff59a85e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:15.139541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:15.140499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:15.141603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:15.141603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:15.141603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:15.141603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:15.141603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 258/512] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:15.142109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156a783-0bca-40be-a00e-698cff59a85e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.150676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:15.154788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:15.169368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f14082-074c-4e89-ba94-59b4981949c5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.204218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd14b1a-79f1-40b2-9fea-b27de912a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.204839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd14b1a-79f1-40b2-9fea-b27de912a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.205124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd14b1a-79f1-40b2-9fea-b27de912a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.205404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd14b1a-79f1-40b2-9fea-b27de912a7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.206134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd14b1a-79f1-40b2-9fea-b27de912a7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:15.206444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd14b1a-79f1-40b2-9fea-b27de912a7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.207821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd14b1a-79f1-40b2-9fea-b27de912a7c4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.219358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 255/513] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:15.220553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd14b1a-79f1-40b2-9fea-b27de912a7c4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.243555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156a783-0bca-40be-a00e-698cff59a85e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.276610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96f231-9073-4a3b-804f-3c74becc5ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.277396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96f231-9073-4a3b-804f-3c74becc5ced None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.277675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96f231-9073-4a3b-804f-3c74becc5ced None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.278081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96f231-9073-4a3b-804f-3c74becc5ced None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.288711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96f231-9073-4a3b-804f-3c74becc5ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.290184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96f231-9073-4a3b-804f-3c74becc5ced None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ed96f231-9073-4a3b-804f-3c74becc5ced None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:15.307695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:15.308833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:15.309687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:15.309687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:15.309687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:15.309687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:15.309687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 259/514] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:15.310143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96f231-9073-4a3b-804f-3c74becc5ced None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.324212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd14b1a-79f1-40b2-9fea-b27de912a7c4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.356907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d0be7-64e0-4233-a10a-77875488b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.357550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d0be7-64e0-4233-a10a-77875488b861 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.357832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d0be7-64e0-4233-a10a-77875488b861 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.358114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d0be7-64e0-4233-a10a-77875488b861 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.366622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:15.373503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:15.407045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96f231-9073-4a3b-804f-3c74becc5ced None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.425092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d0be7-64e0-4233-a10a-77875488b861 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.426556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0d0be7-64e0-4233-a10a-77875488b861 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.439415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301af34-87fa-4675-a114-a83bf731f635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.440071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301af34-87fa-4675-a114-a83bf731f635 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.440347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301af34-87fa-4675-a114-a83bf731f635 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.440647 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e301af34-87fa-4675-a114-a83bf731f635 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.441477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301af34-87fa-4675-a114-a83bf731f635 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:15.441780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301af34-87fa-4675-a114-a83bf731f635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.443212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e301af34-87fa-4675-a114-a83bf731f635 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.460229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 260/515] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 07:16:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:15.460992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301af34-87fa-4675-a114-a83bf731f635 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.525720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 256/516] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:15.526551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d0be7-64e0-4233-a10a-77875488b861 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.560414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e301af34-87fa-4675-a114-a83bf731f635 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.572649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:15.576932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:15.597683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb1589-15a4-4edd-8614-f9f204815bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.598355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb1589-15a4-4edd-8614-f9f204815bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.598634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb1589-15a4-4edd-8614-f9f204815bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.598909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdb1589-15a4-4edd-8614-f9f204815bc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.599633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb1589-15a4-4edd-8614-f9f204815bc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:15.600600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb1589-15a4-4edd-8614-f9f204815bc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.601992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdb1589-15a4-4edd-8614-f9f204815bc4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.613075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 261/517] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:15.613864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb1589-15a4-4edd-8614-f9f204815bc4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.627342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0d0be7-64e0-4233-a10a-77875488b861 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.661506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5fb5-55e6-4aa5-8d5b-a536af24ba2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.662751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5fb5-55e6-4aa5-8d5b-a536af24ba2d None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.663241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5fb5-55e6-4aa5-8d5b-a536af24ba2d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.663564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d5fb5-55e6-4aa5-8d5b-a536af24ba2d None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.664277 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d5fb5-55e6-4aa5-8d5b-a536af24ba2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.665738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d5fb5-55e6-4aa5-8d5b-a536af24ba2d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.711790 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdb1589-15a4-4edd-8614-f9f204815bc4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.744817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a3b5-27a5-4eb0-9c63-68bea37755dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.745468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a3b5-27a5-4eb0-9c63-68bea37755dc None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.745747 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a3b5-27a5-4eb0-9c63-68bea37755dc None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.746021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53a3b5-27a5-4eb0-9c63-68bea37755dc None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.746769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53a3b5-27a5-4eb0-9c63-68bea37755dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:15.747075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53a3b5-27a5-4eb0-9c63-68bea37755dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.748510 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53a3b5-27a5-4eb0-9c63-68bea37755dc None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.754154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 257/518] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:16:15 2022] POST /identity/v3/users => generated 247 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:15.754978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5fb5-55e6-4aa5-8d5b-a536af24ba2d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.771036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 262/519] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:15.772604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a3b5-27a5-4eb0-9c63-68bea37755dc None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:15.816835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:15.878210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d5fb5-55e6-4aa5-8d5b-a536af24ba2d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.880365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:15.891970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53a3b5-27a5-4eb0-9c63-68bea37755dc None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:15.925840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203da38-6b33-4ab1-8ef7-6820f4264d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.926509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203da38-6b33-4ab1-8ef7-6820f4264d93 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.926860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203da38-6b33-4ab1-8ef7-6820f4264d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.927131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203da38-6b33-4ab1-8ef7-6820f4264d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.931964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b46125-6845-430d-999c-c25e70b22b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:15.933252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46125-6845-430d-999c-c25e70b22b6d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:15.933252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46125-6845-430d-999c-c25e70b22b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:15.933404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b46125-6845-430d-999c-c25e70b22b6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:15.946103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b46125-6845-430d-999c-c25e70b22b6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:15.947613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b46125-6845-430d-999c-c25e70b22b6d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-e9b46125-6845-430d-999c-c25e70b22b6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:15.967850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:15.968947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:15.970159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:15.970159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:15.970159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:15.970159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:15.970159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 263/520] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:15.970159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b46125-6845-430d-999c-c25e70b22b6d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.008494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203da38-6b33-4ab1-8ef7-6820f4264d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.010103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203da38-6b33-4ab1-8ef7-6820f4264d93 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.067814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:16.079961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b46125-6845-430d-999c-c25e70b22b6d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:16.115863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b66b9-028b-48ae-ac5d-80aed6ad5b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:16.116686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b66b9-028b-48ae-ac5d-80aed6ad5b36 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:16.117010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b66b9-028b-48ae-ac5d-80aed6ad5b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:16.117230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b66b9-028b-48ae-ac5d-80aed6ad5b36 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:16.122718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 258/521] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:16.122718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203da38-6b33-4ab1-8ef7-6820f4264d93 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.124390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b66b9-028b-48ae-ac5d-80aed6ad5b36 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.124616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:16.125890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b66b9-028b-48ae-ac5d-80aed6ad5b36 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-897b66b9-028b-48ae-ac5d-80aed6ad5b36 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:16.140753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:16.141828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:16.142698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:16.142698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:16.142698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:16.142698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:16.142698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:16.142698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:16.142698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:16.142698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:16.142698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 264/522] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:16.143179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b66b9-028b-48ae-ac5d-80aed6ad5b36 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.231350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203da38-6b33-4ab1-8ef7-6820f4264d93 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:16.266284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74271e8-5175-41fa-85c4-a0a0668ebd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:16.266976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b66b9-028b-48ae-ac5d-80aed6ad5b36 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:16.267102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74271e8-5175-41fa-85c4-a0a0668ebd9c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:16.267375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74271e8-5175-41fa-85c4-a0a0668ebd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:16.267648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74271e8-5175-41fa-85c4-a0a0668ebd9c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:16.276842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74271e8-5175-41fa-85c4-a0a0668ebd9c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.278385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74271e8-5175-41fa-85c4-a0a0668ebd9c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d74271e8-5175-41fa-85c4-a0a0668ebd9c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:16.294031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:16.295033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:16.295921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 259/523] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:16.296469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74271e8-5175-41fa-85c4-a0a0668ebd9c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.307789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc3c2-d09c-4384-b71c-58ef03666ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:16.308181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc3c2-d09c-4384-b71c-58ef03666ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:16.308464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc3c2-d09c-4384-b71c-58ef03666ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:16.308770 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3bc3c2-d09c-4384-b71c-58ef03666ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:16.309545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc3c2-d09c-4384-b71c-58ef03666ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:16.309806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc3c2-d09c-4384-b71c-58ef03666ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.311205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3bc3c2-d09c-4384-b71c-58ef03666ef5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.329256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 265/524] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:16.329256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc3c2-d09c-4384-b71c-58ef03666ef5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.340407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:16.366563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:16.405309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74271e8-5175-41fa-85c4-a0a0668ebd9c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:16.438697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3bc3c2-d09c-4384-b71c-58ef03666ef5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:16.445499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2713c-0e79-4091-99ab-59b423f65575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:16.446292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2713c-0e79-4091-99ab-59b423f65575 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:16.446574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2713c-0e79-4091-99ab-59b423f65575 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:16.447079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a2713c-0e79-4091-99ab-59b423f65575 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:16.457312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2713c-0e79-4091-99ab-59b423f65575 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.458763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a2713c-0e79-4091-99ab-59b423f65575 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.476070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0433d8-9d48-4338-95c2-8be2696e2620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:16.476769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0433d8-9d48-4338-95c2-8be2696e2620 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:16.477047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0433d8-9d48-4338-95c2-8be2696e2620 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-03a2713c-0e79-4091-99ab-59b423f65575 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:16.477307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:16.478146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:16.479566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:16.479566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:16.479566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:16.479566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:16.479829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0433d8-9d48-4338-95c2-8be2696e2620 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:16.479829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0433d8-9d48-4338-95c2-8be2696e2620 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:16.479829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0433d8-9d48-4338-95c2-8be2696e2620 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.480006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 260/525] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:16.480207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0433d8-9d48-4338-95c2-8be2696e2620 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.483673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2713c-0e79-4091-99ab-59b423f65575 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.498797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 266/526] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:16.499622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0433d8-9d48-4338-95c2-8be2696e2620 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.569692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:16.600634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a2713c-0e79-4091-99ab-59b423f65575 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:16.610059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0433d8-9d48-4338-95c2-8be2696e2620 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:16.619813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:16.640853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12781e87-51ab-4495-ae35-6e465863d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:16.641530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12781e87-51ab-4495-ae35-6e465863d97b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:16.641812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12781e87-51ab-4495-ae35-6e465863d97b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:16.642096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12781e87-51ab-4495-ae35-6e465863d97b None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:16.642956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12781e87-51ab-4495-ae35-6e465863d97b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:16.643266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12781e87-51ab-4495-ae35-6e465863d97b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.644789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12781e87-51ab-4495-ae35-6e465863d97b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.646185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da425af2-f68a-4ec9-875e-fdef8f885f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:16.647488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425af2-f68a-4ec9-875e-fdef8f885f75 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:16.647768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425af2-f68a-4ec9-875e-fdef8f885f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:16.648036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da425af2-f68a-4ec9-875e-fdef8f885f75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:16.654937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da425af2-f68a-4ec9-875e-fdef8f885f75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.656371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da425af2-f68a-4ec9-875e-fdef8f885f75 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-da425af2-f68a-4ec9-875e-fdef8f885f75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:16.669970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:16.670816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 267/527] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:16.676299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da425af2-f68a-4ec9-875e-fdef8f885f75 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.692961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 261/528] 10.222.0.24 () {56 vars in 1139 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:16.697805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12781e87-51ab-4495-ae35-6e465863d97b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.783155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da425af2-f68a-4ec9-875e-fdef8f885f75 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:16.802684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12781e87-51ab-4495-ae35-6e465863d97b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:16.810674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:16.819615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedff6d6-a3ac-4b83-85ee-2211c8553b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:16.820313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedff6d6-a3ac-4b83-85ee-2211c8553b76 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:16.820585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedff6d6-a3ac-4b83-85ee-2211c8553b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:16.825944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedff6d6-a3ac-4b83-85ee-2211c8553b76 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:16.825944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedff6d6-a3ac-4b83-85ee-2211c8553b76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:16.825944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedff6d6-a3ac-4b83-85ee-2211c8553b76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.825944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedff6d6-a3ac-4b83-85ee-2211c8553b76 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.835424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 268/529] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:16.836158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedff6d6-a3ac-4b83-85ee-2211c8553b76 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.845794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5f42a-1ef8-42f7-bca6-46c4cbe4ef70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:16.846114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5f42a-1ef8-42f7-bca6-46c4cbe4ef70 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:16.846395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5f42a-1ef8-42f7-bca6-46c4cbe4ef70 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:16.846668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5f42a-1ef8-42f7-bca6-46c4cbe4ef70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:16.847501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5f42a-1ef8-42f7-bca6-46c4cbe4ef70 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=451754f5553e4b9783b4e75f6d408ab6) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:16.847814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5f42a-1ef8-42f7-bca6-46c4cbe4ef70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:16.849286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5f42a-1ef8-42f7-bca6-46c4cbe4ef70 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:16.854924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 262/530] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/role_assignments?user.id=451754f5553e4b9783b4e75f6d408ab6&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:16.855695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5f42a-1ef8-42f7-bca6-46c4cbe4ef70 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:16.913137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:16.977663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedff6d6-a3ac-4b83-85ee-2211c8553b76 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:17.001269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5f42a-1ef8-42f7-bca6-46c4cbe4ef70 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:17.029224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6e1f1-f046-4134-841b-754bc9657aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:17.030171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6e1f1-f046-4134-841b-754bc9657aff None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:17.030915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6e1f1-f046-4134-841b-754bc9657aff None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:17.031844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d6e1f1-f046-4134-841b-754bc9657aff None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:17.033138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6e1f1-f046-4134-841b-754bc9657aff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:17.033666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6e1f1-f046-4134-841b-754bc9657aff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:17.036314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d6e1f1-f046-4134-841b-754bc9657aff None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:17.043540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789b70-008d-402c-b6ed-33248e97066b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:17.044295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789b70-008d-402c-b6ed-33248e97066b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:17.044674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789b70-008d-402c-b6ed-33248e97066b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:17.045019 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a789b70-008d-402c-b6ed-33248e97066b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:17.053314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 269/531] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:17.054540 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6e1f1-f046-4134-841b-754bc9657aff None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:17.118963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:17.136543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a789b70-008d-402c-b6ed-33248e97066b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:17.138018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a789b70-008d-402c-b6ed-33248e97066b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:17.176671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:17.192342 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d6e1f1-f046-4134-841b-754bc9657aff None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:17.236163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938a4d4-d2e9-430b-ac69-15270a2f1547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:17.237640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938a4d4-d2e9-430b-ac69-15270a2f1547 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:17.238128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938a4d4-d2e9-430b-ac69-15270a2f1547 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:17.238761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938a4d4-d2e9-430b-ac69-15270a2f1547 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:17.248897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938a4d4-d2e9-430b-ac69-15270a2f1547 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:17.254486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 263/532] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:17.254486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789b70-008d-402c-b6ed-33248e97066b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:17.255395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938a4d4-d2e9-430b-ac69-15270a2f1547 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6938a4d4-d2e9-430b-ac69-15270a2f1547 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:17.274579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:17.275691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:17.276787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:17.276787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:17.276787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:17.276787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:17.276787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:17.276787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:17.276787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:17.276787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:17.279037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 270/533] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:17.280354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938a4d4-d2e9-430b-ac69-15270a2f1547 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:17.365930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a789b70-008d-402c-b6ed-33248e97066b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:17.401534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938a4d4-d2e9-430b-ac69-15270a2f1547 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:17.408695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96e691-3de3-419e-906d-9836b73e4e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:17.409544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96e691-3de3-419e-906d-9836b73e4e08 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:17.410374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96e691-3de3-419e-906d-9836b73e4e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:17.410833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da96e691-3de3-419e-906d-9836b73e4e08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:17.411832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96e691-3de3-419e-906d-9836b73e4e08 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=e08e18aa7d0941f9892986e737ba9e98) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:17.412795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:17.413087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96e691-3de3-419e-906d-9836b73e4e08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:17.415108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da96e691-3de3-419e-906d-9836b73e4e08 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:17.420461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:17.423367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 264/534] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:17 2022] GET /identity/v3/role_assignments?user.id=e08e18aa7d0941f9892986e737ba9e98&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:17.424160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96e691-3de3-419e-906d-9836b73e4e08 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:17.461189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0e99d-6769-45b0-8d3b-a5968ef35833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:17.462040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0e99d-6769-45b0-8d3b-a5968ef35833 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:17.462388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0e99d-6769-45b0-8d3b-a5968ef35833 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:17.462668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df0e99d-6769-45b0-8d3b-a5968ef35833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:17.484311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0e99d-6769-45b0-8d3b-a5968ef35833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:17.485842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df0e99d-6769-45b0-8d3b-a5968ef35833 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6df0e99d-6769-45b0-8d3b-a5968ef35833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:17.523080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:17.524025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:17.524912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:17.524912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:17.524912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:17.524912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:17.524912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 271/535] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:17.531513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0e99d-6769-45b0-8d3b-a5968ef35833 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:17.662328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da96e691-3de3-419e-906d-9836b73e4e08 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:17.688994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df0e99d-6769-45b0-8d3b-a5968ef35833 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:17.703266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1734ad1-b5b4-44f9-a0f0-3df48e67baca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:17.704212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1734ad1-b5b4-44f9-a0f0-3df48e67baca None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:17.704692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1734ad1-b5b4-44f9-a0f0-3df48e67baca None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:17.705197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1734ad1-b5b4-44f9-a0f0-3df48e67baca None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:17.706186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1734ad1-b5b4-44f9-a0f0-3df48e67baca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:17.706664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1734ad1-b5b4-44f9-a0f0-3df48e67baca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:17.708316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1734ad1-b5b4-44f9-a0f0-3df48e67baca None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:17.728261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799505e-267c-4e36-9e49-b96e20582a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:17.732740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799505e-267c-4e36-9e49-b96e20582a3b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:17.732740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799505e-267c-4e36-9e49-b96e20582a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:17.732740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799505e-267c-4e36-9e49-b96e20582a3b None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:17.732740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799505e-267c-4e36-9e49-b96e20582a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:17.732740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799505e-267c-4e36-9e49-b96e20582a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:17.732740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799505e-267c-4e36-9e49-b96e20582a3b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:17.733249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 265/536] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:17.735082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1734ad1-b5b4-44f9-a0f0-3df48e67baca None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:17.746859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 272/537] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:17.753714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799505e-267c-4e36-9e49-b96e20582a3b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:17.795615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:17.810620 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:17.883255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1734ad1-b5b4-44f9-a0f0-3df48e67baca None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:17.938992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799505e-267c-4e36-9e49-b96e20582a3b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:17.950294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a54fa-39ef-4838-9821-3f396cbccae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:17.950957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a54fa-39ef-4838-9821-3f396cbccae9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:17.951237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a54fa-39ef-4838-9821-3f396cbccae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:17.951510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1a54fa-39ef-4838-9821-3f396cbccae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:17.952343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a54fa-39ef-4838-9821-3f396cbccae9 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=3a06a84967694e68a3a77bf29f16ee3b) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:17.952675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a54fa-39ef-4838-9821-3f396cbccae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:17.954110 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1a54fa-39ef-4838-9821-3f396cbccae9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:17.965116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 266/538] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:17 2022] GET /identity/v3/role_assignments?user.id=3a06a84967694e68a3a77bf29f16ee3b&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:18.009380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e6cfd0-c47d-4682-b5e2-05b60e032b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:18.010209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6cfd0-c47d-4682-b5e2-05b60e032b2b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:18.010491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6cfd0-c47d-4682-b5e2-05b60e032b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:18.010764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e6cfd0-c47d-4682-b5e2-05b60e032b2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:18.018979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6cfd0-c47d-4682-b5e2-05b60e032b2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:18.020508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e6cfd0-c47d-4682-b5e2-05b60e032b2b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c3e6cfd0-c47d-4682-b5e2-05b60e032b2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:18.036259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:18.037759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:18.039040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:18.039040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:18.039040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:18.039040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:18.039040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:18.039040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:18.039040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:18.039040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:18.039040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 273/539] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:18.045649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a54fa-39ef-4838-9821-3f396cbccae9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:18.158152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bbdf-e2c1-45e0-a91c-ff0cd87d36a6 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:18.158504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bbdf-e2c1-45e0-a91c-ff0cd87d36a6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:18.158707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4161bbdf-e2c1-45e0-a91c-ff0cd87d36a6 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:18.160391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 274/540] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:16:18.166179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81368ddc-f883-4c98-bf4e-ede9a6f34e30 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:18.166479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81368ddc-f883-4c98-bf4e-ede9a6f34e30 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:18.166738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81368ddc-f883-4c98-bf4e-ede9a6f34e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:18.203566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-81368ddc-f883-4c98-bf4e-ede9a6f34e30 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:18.205938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-81368ddc-f883-4c98-bf4e-ede9a6f34e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:18.228651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1a54fa-39ef-4838-9821-3f396cbccae9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:18.258493 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:18.271831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b834b-0c22-4434-af73-f8ff5a0fa7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:18.273138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b834b-0c22-4434-af73-f8ff5a0fa7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:18.273634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b834b-0c22-4434-af73-f8ff5a0fa7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:18.274111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b834b-0c22-4434-af73-f8ff5a0fa7b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:18.275115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b834b-0c22-4434-af73-f8ff5a0fa7b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:18.275798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b834b-0c22-4434-af73-f8ff5a0fa7b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:18.279684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b834b-0c22-4434-af73-f8ff5a0fa7b9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:18.292520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 267/541] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:18.299751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b834b-0c22-4434-af73-f8ff5a0fa7b9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:18.365460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 275/542] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:16:18.388975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81368ddc-f883-4c98-bf4e-ede9a6f34e30 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:18.402530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:18.481424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b834b-0c22-4434-af73-f8ff5a0fa7b9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:18.503942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81368ddc-f883-4c98-bf4e-ede9a6f34e30 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:18.543314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1926b8-5fb9-48a0-882d-439bcedfcbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:18.544552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1926b8-5fb9-48a0-882d-439bcedfcbcd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:18.545159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1926b8-5fb9-48a0-882d-439bcedfcbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:18.545636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1926b8-5fb9-48a0-882d-439bcedfcbcd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:18.549152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eb0bf-bcf9-4b6d-95c7-33540358200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:18.549812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eb0bf-bcf9-4b6d-95c7-33540358200b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:18.550095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eb0bf-bcf9-4b6d-95c7-33540358200b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:18.550371 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28eb0bf-bcf9-4b6d-95c7-33540358200b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:18.551217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eb0bf-bcf9-4b6d-95c7-33540358200b None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=a5f94913ac8a463db617fbe30df395b1) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:18.551530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eb0bf-bcf9-4b6d-95c7-33540358200b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:18.553295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28eb0bf-bcf9-4b6d-95c7-33540358200b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:18.558986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1926b8-5fb9-48a0-882d-439bcedfcbcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:18.559613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 268/543] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:18 2022] GET /identity/v3/role_assignments?user.id=a5f94913ac8a463db617fbe30df395b1&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 259 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6c1926b8-5fb9-48a0-882d-439bcedfcbcd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:18.567519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:18.569172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:18.570440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:18.573483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 276/544] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:18.580521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eb0bf-bcf9-4b6d-95c7-33540358200b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:18.644904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:18.698189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28eb0bf-bcf9-4b6d-95c7-33540358200b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:18.736920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fc7e0-e5ef-4edb-adf8-6df81ef21ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:18.737520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fc7e0-e5ef-4edb-adf8-6df81ef21ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:18.737804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fc7e0-e5ef-4edb-adf8-6df81ef21ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:18.738080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700fc7e0-e5ef-4edb-adf8-6df81ef21ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:18.738843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fc7e0-e5ef-4edb-adf8-6df81ef21ad7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:18.739152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fc7e0-e5ef-4edb-adf8-6df81ef21ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:18.740733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700fc7e0-e5ef-4edb-adf8-6df81ef21ad7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:18.750539 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 269/545] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:18.755691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1926b8-5fb9-48a0-882d-439bcedfcbcd None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:18.852327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:18.889525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1926b8-5fb9-48a0-882d-439bcedfcbcd None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:18.931700 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb21e7-4c4c-4cba-9a7e-ae60edfef439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:18.932783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb21e7-4c4c-4cba-9a7e-ae60edfef439 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:18.933317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb21e7-4c4c-4cba-9a7e-ae60edfef439 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:18.933739 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb21e7-4c4c-4cba-9a7e-ae60edfef439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:18.952528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb21e7-4c4c-4cba-9a7e-ae60edfef439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:18.954249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb21e7-4c4c-4cba-9a7e-ae60edfef439 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-28bb21e7-4c4c-4cba-9a7e-ae60edfef439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:18.977672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:18.978801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:18.979882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:18.979882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:18.979882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:18.979882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:18.981795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 277/546] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:18.988576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fc7e0-e5ef-4edb-adf8-6df81ef21ad7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:19.167713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700fc7e0-e5ef-4edb-adf8-6df81ef21ad7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:19.184024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:19.211050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36efd3-cc4f-4242-b920-35de45eaf8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:19.211712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36efd3-cc4f-4242-b920-35de45eaf8f2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:19.212047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36efd3-cc4f-4242-b920-35de45eaf8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:19.212336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36efd3-cc4f-4242-b920-35de45eaf8f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:19.213101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36efd3-cc4f-4242-b920-35de45eaf8f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:19.213414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36efd3-cc4f-4242-b920-35de45eaf8f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:19.214817 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae36efd3-cc4f-4242-b920-35de45eaf8f2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:19.231254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 270/547] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:19.236346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb21e7-4c4c-4cba-9a7e-ae60edfef439 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:19.384736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb21e7-4c4c-4cba-9a7e-ae60edfef439 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:19.389881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f5005-0547-4acf-abce-7051f68844d3 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:19.390174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f5005-0547-4acf-abce-7051f68844d3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:19.390461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725f5005-0547-4acf-abce-7051f68844d3 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:19.391966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 271/548] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:19.404804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e7f9-f401-4146-b7d2-5e6ed84afd72 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:19.405092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e7f9-f401-4146-b7d2-5e6ed84afd72 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:19.405372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2e7f9-f401-4146-b7d2-5e6ed84afd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:19.430989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e8d2e7f9-f401-4146-b7d2-5e6ed84afd72 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:19.432198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e8d2e7f9-f401-4146-b7d2-5e6ed84afd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:19.438835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:19.454025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e978e-ac4d-4671-8b11-8bbcb56d6775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:19.454838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e978e-ac4d-4671-8b11-8bbcb56d6775 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:19.455126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e978e-ac4d-4671-8b11-8bbcb56d6775 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:19.455401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e978e-ac4d-4671-8b11-8bbcb56d6775 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:19.469376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e978e-ac4d-4671-8b11-8bbcb56d6775 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:19.470848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e978e-ac4d-4671-8b11-8bbcb56d6775 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-9f7e978e-ac4d-4671-8b11-8bbcb56d6775 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:19.491821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:19.492821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:19.493720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:19.497271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 278/549] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:19.503114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e978e-ac4d-4671-8b11-8bbcb56d6775 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:19.571515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 272/550] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:19.606156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e7f9-f401-4146-b7d2-5e6ed84afd72 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:19.620271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e978e-ac4d-4671-8b11-8bbcb56d6775 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:19.661353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da0a67-0eb6-4ea3-8dca-6959c6d39636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:19.664310 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da0a67-0eb6-4ea3-8dca-6959c6d39636 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:19.664830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da0a67-0eb6-4ea3-8dca-6959c6d39636 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:19.665418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79da0a67-0eb6-4ea3-8dca-6959c6d39636 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:19.668691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da0a67-0eb6-4ea3-8dca-6959c6d39636 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:19.669248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da0a67-0eb6-4ea3-8dca-6959c6d39636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:19.670912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79da0a67-0eb6-4ea3-8dca-6959c6d39636 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:19.712816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 279/551] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 07:16:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:19.718841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da0a67-0eb6-4ea3-8dca-6959c6d39636 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:19.783911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:19.789033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2e7f9-f401-4146-b7d2-5e6ed84afd72 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:19.819568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:19.836597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ddab-0726-47ee-b652-a5223ca3e485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:19.837721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ddab-0726-47ee-b652-a5223ca3e485 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:19.838979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ddab-0726-47ee-b652-a5223ca3e485 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:19.840248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1ddab-0726-47ee-b652-a5223ca3e485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:19.865846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1ddab-0726-47ee-b652-a5223ca3e485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b7c1ddab-0726-47ee-b652-a5223ca3e485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:19.882573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:19.883521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:19.884341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:19.887082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 273/552] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:19.892570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ddab-0726-47ee-b652-a5223ca3e485 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:19.954551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79da0a67-0eb6-4ea3-8dca-6959c6d39636 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:20.039901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1ddab-0726-47ee-b652-a5223ca3e485 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:20.043623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c84531-113e-4945-b34e-4886f68ceca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:20.044293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84531-113e-4945-b34e-4886f68ceca7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.044660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84531-113e-4945-b34e-4886f68ceca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.044933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c84531-113e-4945-b34e-4886f68ceca7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.110215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a925169-8e27-4463-a29f-c2bc3f232c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:20.111975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a925169-8e27-4463-a29f-c2bc3f232c12 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.112259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a925169-8e27-4463-a29f-c2bc3f232c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.112549 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a925169-8e27-4463-a29f-c2bc3f232c12 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.115007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a925169-8e27-4463-a29f-c2bc3f232c12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:20.116202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a925169-8e27-4463-a29f-c2bc3f232c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:20.122186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a925169-8e27-4463-a29f-c2bc3f232c12 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:20.140068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 274/553] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:20.148259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a925169-8e27-4463-a29f-c2bc3f232c12 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:20.182655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c84531-113e-4945-b34e-4886f68ceca7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:20.184160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c84531-113e-4945-b34e-4886f68ceca7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:20.198404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:20.264749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:20.304978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a925169-8e27-4463-a29f-c2bc3f232c12 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:20.342845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1377d3db-63c6-4c1f-b2e4-231b6dedd12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:20.343969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377d3db-63c6-4c1f-b2e4-231b6dedd12c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.344448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377d3db-63c6-4c1f-b2e4-231b6dedd12c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.344969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1377d3db-63c6-4c1f-b2e4-231b6dedd12c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.350497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 280/554] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:20.350497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff929c7-68fc-46c5-b9d4-524b7dade812 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.350497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff929c7-68fc-46c5-b9d4-524b7dade812 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.350497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff929c7-68fc-46c5-b9d4-524b7dade812 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.350497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 281/555] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:20.351635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff929c7-68fc-46c5-b9d4-524b7dade812 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:20.365827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377d3db-63c6-4c1f-b2e4-231b6dedd12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:20.367794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1377d3db-63c6-4c1f-b2e4-231b6dedd12c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-1377d3db-63c6-4c1f-b2e4-231b6dedd12c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:20.388867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:20.389797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:20.390789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:20.390789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:20.390789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:20.390789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:20.397383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 275/556] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:20.399486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d89bd-5a04-4aaf-aa5c-07d3eaa8c027 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.399989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d89bd-5a04-4aaf-aa5c-07d3eaa8c027 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.400460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940d89bd-5a04-4aaf-aa5c-07d3eaa8c027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.422629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-940d89bd-5a04-4aaf-aa5c-07d3eaa8c027 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:20.424198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-940d89bd-5a04-4aaf-aa5c-07d3eaa8c027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:20.481981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff929c7-68fc-46c5-b9d4-524b7dade812 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:20.501269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 276/557] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:20.509613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d89bd-5a04-4aaf-aa5c-07d3eaa8c027 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:20.514910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:20.536148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead259b-3bfc-4375-ade4-c153b1a933fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:20.536994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead259b-3bfc-4375-ade4-c153b1a933fb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.537864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead259b-3bfc-4375-ade4-c153b1a933fb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.538145 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ead259b-3bfc-4375-ade4-c153b1a933fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.549685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:20.552220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead259b-3bfc-4375-ade4-c153b1a933fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:20.553940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ead259b-3bfc-4375-ade4-c153b1a933fb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-9ead259b-3bfc-4375-ade4-c153b1a933fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:20.573090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:20.574490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:20.575386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:20.575386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:20.575386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:20.575386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:20.577850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 282/558] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:20.579219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead259b-3bfc-4375-ade4-c153b1a933fb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:20.643028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940d89bd-5a04-4aaf-aa5c-07d3eaa8c027 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:20.678964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac684a0-7ca4-4b22-8de6-24335a12c1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:20.679643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac684a0-7ca4-4b22-8de6-24335a12c1d6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.679917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac684a0-7ca4-4b22-8de6-24335a12c1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.680205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac684a0-7ca4-4b22-8de6-24335a12c1d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.680969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac684a0-7ca4-4b22-8de6-24335a12c1d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:20.681282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac684a0-7ca4-4b22-8de6-24335a12c1d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:20.682656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac684a0-7ca4-4b22-8de6-24335a12c1d6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:20.688948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ead259b-3bfc-4375-ade4-c153b1a933fb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:20.698681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 277/559] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:20.698681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a765bd-bd72-4c6e-83c3-c4677ecf8495 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.698681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a765bd-bd72-4c6e-83c3-c4677ecf8495 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.698681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a765bd-bd72-4c6e-83c3-c4677ecf8495 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.698681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 278/560] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:20.699116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a765bd-bd72-4c6e-83c3-c4677ecf8495 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:20.734587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b1a3a-4eab-48a7-b451-ec3dd8a42346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:20.735484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b1a3a-4eab-48a7-b451-ec3dd8a42346 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.735765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b1a3a-4eab-48a7-b451-ec3dd8a42346 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.736032 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b1a3a-4eab-48a7-b451-ec3dd8a42346 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.747911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b1a3a-4eab-48a7-b451-ec3dd8a42346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ad0b1a3a-4eab-48a7-b451-ec3dd8a42346 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:20.755838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:20.757333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 283/561] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:20.758162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b1a3a-4eab-48a7-b451-ec3dd8a42346 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:20.775117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:20.817835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a765bd-bd72-4c6e-83c3-c4677ecf8495 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:20.822464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:20.856622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47ad9a7-3cd5-44ed-8fae-459dd0ae8fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:20.857293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad9a7-3cd5-44ed-8fae-459dd0ae8fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.857574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad9a7-3cd5-44ed-8fae-459dd0ae8fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.857918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47ad9a7-3cd5-44ed-8fae-459dd0ae8fb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.858649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ad9a7-3cd5-44ed-8fae-459dd0ae8fb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:20.858959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ad9a7-3cd5-44ed-8fae-459dd0ae8fb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:20.860340 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47ad9a7-3cd5-44ed-8fae-459dd0ae8fb4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:20.872651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b1a3a-4eab-48a7-b451-ec3dd8a42346 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:20.878153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 279/562] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:20.878153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c63090-3e39-41f6-bbc7-3b4444f96f6d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.878153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c63090-3e39-41f6-bbc7-3b4444f96f6d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.878153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c63090-3e39-41f6-bbc7-3b4444f96f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.891887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b2c63090-3e39-41f6-bbc7-3b4444f96f6d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:20.893104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b2c63090-3e39-41f6-bbc7-3b4444f96f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:20.913677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cc498-d5e5-49b8-882c-5f1ecb2ba419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:20.914490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cc498-d5e5-49b8-882c-5f1ecb2ba419 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:20.914776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cc498-d5e5-49b8-882c-5f1ecb2ba419 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:20.915054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cc498-d5e5-49b8-882c-5f1ecb2ba419 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:20.923197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cc498-d5e5-49b8-882c-5f1ecb2ba419 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:20.924711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cc498-d5e5-49b8-882c-5f1ecb2ba419 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-fc6cc498-d5e5-49b8-882c-5f1ecb2ba419 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:20.940231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:20.941562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 284/563] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:20.943786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cc498-d5e5-49b8-882c-5f1ecb2ba419 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:20.969889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 280/564] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:20.971174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c63090-3e39-41f6-bbc7-3b4444f96f6d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.041067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:21.059868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cc498-d5e5-49b8-882c-5f1ecb2ba419 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.074085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:21.090807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c63090-3e39-41f6-bbc7-3b4444f96f6d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.097247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd303e-d067-4204-a5d2-e1ecb31d3f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.097937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd303e-d067-4204-a5d2-e1ecb31d3f4b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.098277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd303e-d067-4204-a5d2-e1ecb31d3f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.098550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bd303e-d067-4204-a5d2-e1ecb31d3f4b None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.099337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd303e-d067-4204-a5d2-e1ecb31d3f4b None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:21.099674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd303e-d067-4204-a5d2-e1ecb31d3f4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.101148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bd303e-d067-4204-a5d2-e1ecb31d3f4b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.111291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 285/565] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:21.112180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd303e-d067-4204-a5d2-e1ecb31d3f4b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.134921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442eeb5-24c5-495d-b8ae-c9aea5b43fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.135727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442eeb5-24c5-495d-b8ae-c9aea5b43fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.136011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442eeb5-24c5-495d-b8ae-c9aea5b43fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.136285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e442eeb5-24c5-495d-b8ae-c9aea5b43fb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.144655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442eeb5-24c5-495d-b8ae-c9aea5b43fb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.146786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e442eeb5-24c5-495d-b8ae-c9aea5b43fb6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e442eeb5-24c5-495d-b8ae-c9aea5b43fb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:21.163035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:21.163983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:21.164915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:21.164915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:21.164915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:21.164915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:21.164915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:21.164915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:21.164915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:21.164915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:21.164915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 281/566] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:21.165407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442eeb5-24c5-495d-b8ae-c9aea5b43fb6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.229105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bd303e-d067-4204-a5d2-e1ecb31d3f4b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.265663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4658fa-8af9-4750-b206-7d9fb40a5ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.266339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4658fa-8af9-4750-b206-7d9fb40a5ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.266625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4658fa-8af9-4750-b206-7d9fb40a5ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.266905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4658fa-8af9-4750-b206-7d9fb40a5ba4 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.267744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4658fa-8af9-4750-b206-7d9fb40a5ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:21.268062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4658fa-8af9-4750-b206-7d9fb40a5ba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.269528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4658fa-8af9-4750-b206-7d9fb40a5ba4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.274821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e442eeb5-24c5-495d-b8ae-c9aea5b43fb6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.287292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 286/567] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:21.290426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4658fa-8af9-4750-b206-7d9fb40a5ba4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.290910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:21.315714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cdf86-895d-4839-be33-8230b9030fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.315714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cdf86-895d-4839-be33-8230b9030fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.315714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cdf86-895d-4839-be33-8230b9030fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.315714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9cdf86-895d-4839-be33-8230b9030fd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.321527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:21.323459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9cdf86-895d-4839-be33-8230b9030fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7a9cdf86-895d-4839-be33-8230b9030fd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:21.331247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:21.332233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:21.333137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 282/568] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:21.334358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cdf86-895d-4839-be33-8230b9030fd6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.393766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4658fa-8af9-4750-b206-7d9fb40a5ba4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.426778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76499796-0397-49e4-9148-b45d059d24ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.427571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76499796-0397-49e4-9148-b45d059d24ee None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.428525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76499796-0397-49e4-9148-b45d059d24ee None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.429045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76499796-0397-49e4-9148-b45d059d24ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.432397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9cdf86-895d-4839-be33-8230b9030fd6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.438975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76499796-0397-49e4-9148-b45d059d24ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.440440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76499796-0397-49e4-9148-b45d059d24ee None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-76499796-0397-49e4-9148-b45d059d24ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:21.459142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:21.460289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:21.461236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:21.461236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:21.461236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:21.461236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:21.461236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 287/569] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:21.461706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda73816-c412-475e-95ad-220f72d7af08 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.462013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda73816-c412-475e-95ad-220f72d7af08 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.462276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda73816-c412-475e-95ad-220f72d7af08 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.463538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 288/570] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:21.464231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda73816-c412-475e-95ad-220f72d7af08 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.473101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0d92f-d858-4bec-9619-bcf5993d4d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.473777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0d92f-d858-4bec-9619-bcf5993d4d45 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.474048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0d92f-d858-4bec-9619-bcf5993d4d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.474323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0d92f-d858-4bec-9619-bcf5993d4d45 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.475910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0d92f-d858-4bec-9619-bcf5993d4d45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:21.476230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0d92f-d858-4bec-9619-bcf5993d4d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.477710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf0d92f-d858-4bec-9619-bcf5993d4d45 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.489785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 283/571] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:21.491311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0d92f-d858-4bec-9619-bcf5993d4d45 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.526221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:21.550050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:21.566062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda73816-c412-475e-95ad-220f72d7af08 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.590582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf0d92f-d858-4bec-9619-bcf5993d4d45 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.601410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6020fe5-0374-4ab3-a9e5-83877702f5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.602205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6020fe5-0374-4ab3-a9e5-83877702f5ae None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.602486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6020fe5-0374-4ab3-a9e5-83877702f5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.602757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6020fe5-0374-4ab3-a9e5-83877702f5ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.612993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6020fe5-0374-4ab3-a9e5-83877702f5ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.614439 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6020fe5-0374-4ab3-a9e5-83877702f5ae None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.624825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f9138-1e8d-4849-9fd8-bdd754eba200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.625488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9138-1e8d-4849-9fd8-bdd754eba200 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.625769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9138-1e8d-4849-9fd8-bdd754eba200 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.626045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9138-1e8d-4849-9fd8-bdd754eba200 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.626782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f9138-1e8d-4849-9fd8-bdd754eba200 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:21.627086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f9138-1e8d-4849-9fd8-bdd754eba200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.628430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f9138-1e8d-4849-9fd8-bdd754eba200 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-e6020fe5-0374-4ab3-a9e5-83877702f5ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:21.632280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:21.633351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:21.634282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:21.634282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:21.634282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:21.634282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:21.634282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 289/572] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:21.634554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6020fe5-0374-4ab3-a9e5-83877702f5ae None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.645736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 284/573] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:21.645736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafabcc-f399-4fdb-abf9-03b3897433db None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.645736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafabcc-f399-4fdb-abf9-03b3897433db None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.645736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafabcc-f399-4fdb-abf9-03b3897433db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.659318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1bafabcc-f399-4fdb-abf9-03b3897433db None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:21.660530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1bafabcc-f399-4fdb-abf9-03b3897433db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:21.728366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 285/574] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:21.729296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafabcc-f399-4fdb-abf9-03b3897433db None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.734544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6020fe5-0374-4ab3-a9e5-83877702f5ae None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.758826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:21.769330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dab36-c87c-4698-9325-7acf8641fdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.769998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dab36-c87c-4698-9325-7acf8641fdac None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.770277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dab36-c87c-4698-9325-7acf8641fdac None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.770553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7dab36-c87c-4698-9325-7acf8641fdac None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.771275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7dab36-c87c-4698-9325-7acf8641fdac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:21.771782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7dab36-c87c-4698-9325-7acf8641fdac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.773295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7dab36-c87c-4698-9325-7acf8641fdac None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.776030 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:21.785161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 290/575] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:21.786115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dab36-c87c-4698-9325-7acf8641fdac None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.831136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafabcc-f399-4fdb-abf9-03b3897433db None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.865822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14446-bd0c-4ac0-a292-468fb24f7099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.866462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14446-bd0c-4ac0-a292-468fb24f7099 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.866741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14446-bd0c-4ac0-a292-468fb24f7099 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.867013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb14446-bd0c-4ac0-a292-468fb24f7099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.867836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb14446-bd0c-4ac0-a292-468fb24f7099 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=b54767b9f07341c3aa2ba9a120a62ed0) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:21.868137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb14446-bd0c-4ac0-a292-468fb24f7099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.869594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb14446-bd0c-4ac0-a292-468fb24f7099 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.875041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 286/576] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/role_assignments?user.id=b54767b9f07341c3aa2ba9a120a62ed0&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:21.875817 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14446-bd0c-4ac0-a292-468fb24f7099 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.890277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7dab36-c87c-4698-9325-7acf8641fdac None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:21.930959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd7086-597c-413c-8fef-581a63bda935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:21.931677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd7086-597c-413c-8fef-581a63bda935 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:21.931963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd7086-597c-413c-8fef-581a63bda935 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:21.932233 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd7086-597c-413c-8fef-581a63bda935 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:21.933007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd7086-597c-413c-8fef-581a63bda935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:21.933311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd7086-597c-413c-8fef-581a63bda935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:21.934744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd7086-597c-413c-8fef-581a63bda935 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:21.948929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 291/577] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:21.949841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd7086-597c-413c-8fef-581a63bda935 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:21.992953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:22.004276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb14446-bd0c-4ac0-a292-468fb24f7099 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.013957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:22.045408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77153b56-0f5f-4286-8d8d-4fba40efb4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.046223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77153b56-0f5f-4286-8d8d-4fba40efb4cc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.046512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77153b56-0f5f-4286-8d8d-4fba40efb4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.046788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77153b56-0f5f-4286-8d8d-4fba40efb4cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.059386 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77153b56-0f5f-4286-8d8d-4fba40efb4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.060887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77153b56-0f5f-4286-8d8d-4fba40efb4cc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.063425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd7086-597c-413c-8fef-581a63bda935 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-77153b56-0f5f-4286-8d8d-4fba40efb4cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:22.084898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:22.086026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:22.086996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:22.086996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:22.086996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:22.086996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:22.086996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 287/578] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:22.087420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77153b56-0f5f-4286-8d8d-4fba40efb4cc None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.106441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46fff6-8740-41c7-8e0c-287eef974128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.107271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46fff6-8740-41c7-8e0c-287eef974128 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.107556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46fff6-8740-41c7-8e0c-287eef974128 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.107833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46fff6-8740-41c7-8e0c-287eef974128 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.118261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46fff6-8740-41c7-8e0c-287eef974128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-5b46fff6-8740-41c7-8e0c-287eef974128 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:22.126034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:22.127175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 292/579] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:22.128174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46fff6-8740-41c7-8e0c-287eef974128 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.200969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77153b56-0f5f-4286-8d8d-4fba40efb4cc None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.236845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af718-682a-4da2-85de-038c97717384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.237643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af718-682a-4da2-85de-038c97717384 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.237923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af718-682a-4da2-85de-038c97717384 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.238196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764af718-682a-4da2-85de-038c97717384 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.239405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46fff6-8740-41c7-8e0c-287eef974128 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.245783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af718-682a-4da2-85de-038c97717384 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.247412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764af718-682a-4da2-85de-038c97717384 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.257553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-764af718-682a-4da2-85de-038c97717384 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:22.263048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:22.263995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 288/580] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:22.265550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af718-682a-4da2-85de-038c97717384 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.271096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:22.280636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af650c-503c-48b2-aeb1-112c49b42990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.281199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af650c-503c-48b2-aeb1-112c49b42990 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.281482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af650c-503c-48b2-aeb1-112c49b42990 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.281763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af650c-503c-48b2-aeb1-112c49b42990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.289535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af650c-503c-48b2-aeb1-112c49b42990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.291177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72af650c-503c-48b2-aeb1-112c49b42990 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-72af650c-503c-48b2-aeb1-112c49b42990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:22.310193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:22.311254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:22.312221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:22.312221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:22.312221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:22.312221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:22.312221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:22.312221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:22.312221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:22.312221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:22.312221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 293/581] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:22.312732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af650c-503c-48b2-aeb1-112c49b42990 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.380216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764af718-682a-4da2-85de-038c97717384 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.419369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe9f64-2c70-463d-88d7-509b9204ddab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.420042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9f64-2c70-463d-88d7-509b9204ddab None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.420340 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9f64-2c70-463d-88d7-509b9204ddab None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.420717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfe9f64-2c70-463d-88d7-509b9204ddab None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.421461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe9f64-2c70-463d-88d7-509b9204ddab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:22.421774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe9f64-2c70-463d-88d7-509b9204ddab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.423152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfe9f64-2c70-463d-88d7-509b9204ddab None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.424793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af650c-503c-48b2-aeb1-112c49b42990 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.436432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 289/582] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:22.437280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe9f64-2c70-463d-88d7-509b9204ddab None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.470113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789db31a-1a54-41ae-a14f-c48e8f96d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.470865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789db31a-1a54-41ae-a14f-c48e8f96d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.471199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789db31a-1a54-41ae-a14f-c48e8f96d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.471470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789db31a-1a54-41ae-a14f-c48e8f96d2a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.472243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789db31a-1a54-41ae-a14f-c48e8f96d2a8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:22.472580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789db31a-1a54-41ae-a14f-c48e8f96d2a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.474005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789db31a-1a54-41ae-a14f-c48e8f96d2a8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.482900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 294/583] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:22.488051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789db31a-1a54-41ae-a14f-c48e8f96d2a8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.505723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:22.530145 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:22.548181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfe9f64-2c70-463d-88d7-509b9204ddab None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.594725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d5ab6-f7b6-452c-b305-9be8aa887e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.595181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789db31a-1a54-41ae-a14f-c48e8f96d2a8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.595422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d5ab6-f7b6-452c-b305-9be8aa887e72 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.595710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d5ab6-f7b6-452c-b305-9be8aa887e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.595986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d5ab6-f7b6-452c-b305-9be8aa887e72 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.596871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d5ab6-f7b6-452c-b305-9be8aa887e72 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:22.597241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d5ab6-f7b6-452c-b305-9be8aa887e72 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.598789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d5ab6-f7b6-452c-b305-9be8aa887e72 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.618446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 290/584] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:22.619184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d5ab6-f7b6-452c-b305-9be8aa887e72 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.636860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef38ce-3c27-4bb3-87d4-b481b18acbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.637450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef38ce-3c27-4bb3-87d4-b481b18acbd7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.637733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef38ce-3c27-4bb3-87d4-b481b18acbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.638008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef38ce-3c27-4bb3-87d4-b481b18acbd7 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.638798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef38ce-3c27-4bb3-87d4-b481b18acbd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:22.639109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef38ce-3c27-4bb3-87d4-b481b18acbd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.640572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef38ce-3c27-4bb3-87d4-b481b18acbd7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.653789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 295/585] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:22.654619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef38ce-3c27-4bb3-87d4-b481b18acbd7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.729734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d5ab6-f7b6-452c-b305-9be8aa887e72 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.751366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:22.756735 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:22.761052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef38ce-3c27-4bb3-87d4-b481b18acbd7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.765782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0cf4f-f446-4961-9167-0350d3a1ce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.766572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0cf4f-f446-4961-9167-0350d3a1ce8c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.766852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0cf4f-f446-4961-9167-0350d3a1ce8c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.767124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0cf4f-f446-4961-9167-0350d3a1ce8c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.774667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0cf4f-f446-4961-9167-0350d3a1ce8c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.776117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0cf4f-f446-4961-9167-0350d3a1ce8c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-76a0cf4f-f446-4961-9167-0350d3a1ce8c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:22.791130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:22.792151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 291/586] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:22.793639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0cf4f-f446-4961-9167-0350d3a1ce8c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.800053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a495a9-1056-40a3-8370-dbd492ef99a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.800888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a495a9-1056-40a3-8370-dbd492ef99a9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.801172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a495a9-1056-40a3-8370-dbd492ef99a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.801446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a495a9-1056-40a3-8370-dbd492ef99a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.814537 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a495a9-1056-40a3-8370-dbd492ef99a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.816427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a495a9-1056-40a3-8370-dbd492ef99a9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c2a495a9-1056-40a3-8370-dbd492ef99a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:22.834639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:22.835539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:22.836453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:22.836453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:22.836453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:22.836453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:22.836453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 296/587] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:22.837301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a495a9-1056-40a3-8370-dbd492ef99a9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.895470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0cf4f-f446-4961-9167-0350d3a1ce8c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.932970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cf951-bc53-4b37-8f52-7cbd37dd7105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.933766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf951-bc53-4b37-8f52-7cbd37dd7105 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.934047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf951-bc53-4b37-8f52-7cbd37dd7105 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.934574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cf951-bc53-4b37-8f52-7cbd37dd7105 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:22.943127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a495a9-1056-40a3-8370-dbd492ef99a9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:22.945715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf951-bc53-4b37-8f52-7cbd37dd7105 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:22.947168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781cf951-bc53-4b37-8f52-7cbd37dd7105 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-781cf951-bc53-4b37-8f52-7cbd37dd7105 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:22.966326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:22.967542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:22.968449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:22.968449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:22.968449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:22.968449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:22.968449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 292/588] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:22.969360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cf951-bc53-4b37-8f52-7cbd37dd7105 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:22.984334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59eb95-d9d0-4d05-bc05-42151fd85a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:22.985281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59eb95-d9d0-4d05-bc05-42151fd85a72 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:22.985564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59eb95-d9d0-4d05-bc05-42151fd85a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:22.985839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf59eb95-d9d0-4d05-bc05-42151fd85a72 None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/451754f5553e4b9783b4e75f6d408ab6/roles/94ab939081724a88a65a1961cc1826b8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.001928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59eb95-d9d0-4d05-bc05-42151fd85a72 None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=451754f5553e4b9783b4e75f6d408ab6, role_id=94ab939081724a88a65a1961cc1826b8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.003375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf59eb95-d9d0-4d05-bc05-42151fd85a72 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.004980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:23.070970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:23.074352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781cf951-bc53-4b37-8f52-7cbd37dd7105 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:23.084515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 297/589] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:16:22 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/451754f5553e4b9783b4e75f6d408ab6/roles/94ab939081724a88a65a1961cc1826b8 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:16:23.084515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59eb95-d9d0-4d05-bc05-42151fd85a72 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:23.125199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4c48-a7a5-4616-86ed-d98f956d025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:23.125986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4c48-a7a5-4616-86ed-d98f956d025e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:23.126339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4c48-a7a5-4616-86ed-d98f956d025e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:23.126681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d4c48-a7a5-4616-86ed-d98f956d025e None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.127774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d4c48-a7a5-4616-86ed-d98f956d025e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:23.128210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d4c48-a7a5-4616-86ed-d98f956d025e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.129905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d4c48-a7a5-4616-86ed-d98f956d025e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.158145 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 293/590] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 07:16:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:23.160075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4c48-a7a5-4616-86ed-d98f956d025e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:23.238780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf59eb95-d9d0-4d05-bc05-42151fd85a72 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:23.278173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:23.284521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608126a-b384-4907-bd98-012febd33434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:23.284521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608126a-b384-4907-bd98-012febd33434 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:23.284521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608126a-b384-4907-bd98-012febd33434 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:23.284521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e608126a-b384-4907-bd98-012febd33434 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.284900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608126a-b384-4907-bd98-012febd33434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:23.284900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608126a-b384-4907-bd98-012febd33434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.287431 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e608126a-b384-4907-bd98-012febd33434 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.290269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d4c48-a7a5-4616-86ed-d98f956d025e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:23.300714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 298/591] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:23.301515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608126a-b384-4907-bd98-012febd33434 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:23.337374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc184bc6-eb4b-457e-9363-9b77e6e516a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:23.338040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc184bc6-eb4b-457e-9363-9b77e6e516a9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:23.338322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc184bc6-eb4b-457e-9363-9b77e6e516a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:23.338599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc184bc6-eb4b-457e-9363-9b77e6e516a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.339328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc184bc6-eb4b-457e-9363-9b77e6e516a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:23.339636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc184bc6-eb4b-457e-9363-9b77e6e516a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.341068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc184bc6-eb4b-457e-9363-9b77e6e516a9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.360885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 294/592] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:23.361574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc184bc6-eb4b-457e-9363-9b77e6e516a9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:23.374064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:23.425533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e608126a-b384-4907-bd98-012febd33434 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:23.461249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0f9d9-9a28-4ba3-bc56-9c13ed4bad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:23.462284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0f9d9-9a28-4ba3-bc56-9c13ed4bad26 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:23.462709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0f9d9-9a28-4ba3-bc56-9c13ed4bad26 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:23.463123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0f9d9-9a28-4ba3-bc56-9c13ed4bad26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.475018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0f9d9-9a28-4ba3-bc56-9c13ed4bad26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.477153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0f9d9-9a28-4ba3-bc56-9c13ed4bad26 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-1ce0f9d9-9a28-4ba3-bc56-9c13ed4bad26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:23.495931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:23.497052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:23.498071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:23.498071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:23.498071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:23.498071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:23.498942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc184bc6-eb4b-457e-9363-9b77e6e516a9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:23.500055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 299/593] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:23.500997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0f9d9-9a28-4ba3-bc56-9c13ed4bad26 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:23.549974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d43c-ae89-4a8a-b785-fc1508993eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:23.550787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d43c-ae89-4a8a-b785-fc1508993eba None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:23.551074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d43c-ae89-4a8a-b785-fc1508993eba None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:23.551616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46d43c-ae89-4a8a-b785-fc1508993eba None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.563659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d43c-ae89-4a8a-b785-fc1508993eba None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.565595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46d43c-ae89-4a8a-b785-fc1508993eba None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-4c46d43c-ae89-4a8a-b785-fc1508993eba None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:23.587800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:23.589038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:16:23.590193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:23.597968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 295/594] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:23.599171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d43c-ae89-4a8a-b785-fc1508993eba None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:23.613412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:23.619424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0f9d9-9a28-4ba3-bc56-9c13ed4bad26 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:23.637085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:23.665524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a6967-6379-480d-94a7-6dc7a9fbf734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:23.666609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a6967-6379-480d-94a7-6dc7a9fbf734 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:23.666908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a6967-6379-480d-94a7-6dc7a9fbf734 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:23.667229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a6967-6379-480d-94a7-6dc7a9fbf734 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.678838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a6967-6379-480d-94a7-6dc7a9fbf734 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.681503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a6967-6379-480d-94a7-6dc7a9fbf734 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3f3a6967-6379-480d-94a7-6dc7a9fbf734 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:23.697044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:23.698179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:23.699316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:23.699316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:23.699316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:23.699316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:23.699316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:23.699316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:23.699316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:23.699316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:23.701659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 300/595] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:23.702570 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a6967-6379-480d-94a7-6dc7a9fbf734 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:23.717306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46d43c-ae89-4a8a-b785-fc1508993eba None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:23.756436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f946b-65d0-4bdc-868e-d61bfe0f9890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:23.757518 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f946b-65d0-4bdc-868e-d61bfe0f9890 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:23.757904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f946b-65d0-4bdc-868e-d61bfe0f9890 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:23.758285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f946b-65d0-4bdc-868e-d61bfe0f9890 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.759120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f946b-65d0-4bdc-868e-d61bfe0f9890 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:23.759501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f946b-65d0-4bdc-868e-d61bfe0f9890 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.761111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68f946b-65d0-4bdc-868e-d61bfe0f9890 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.774856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 296/596] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:23.780161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f946b-65d0-4bdc-868e-d61bfe0f9890 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:23.837379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a6967-6379-480d-94a7-6dc7a9fbf734 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:23.854291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:23.882773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad585d30-38ac-45d5-9cba-bae66fd0d78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:23.883704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585d30-38ac-45d5-9cba-bae66fd0d78b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:23.884054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585d30-38ac-45d5-9cba-bae66fd0d78b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:23.884404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad585d30-38ac-45d5-9cba-bae66fd0d78b None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.885951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad585d30-38ac-45d5-9cba-bae66fd0d78b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:23.886337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad585d30-38ac-45d5-9cba-bae66fd0d78b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.888382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad585d30-38ac-45d5-9cba-bae66fd0d78b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.890923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68f946b-65d0-4bdc-868e-d61bfe0f9890 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:23.918084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 301/597] 10.222.0.24 () {56 vars in 1139 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:23.918084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad585d30-38ac-45d5-9cba-bae66fd0d78b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:23.934374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566b72f-0980-49a0-aeab-a4fc26e45367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:23.936233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566b72f-0980-49a0-aeab-a4fc26e45367 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:23.936863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566b72f-0980-49a0-aeab-a4fc26e45367 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:23.937324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2566b72f-0980-49a0-aeab-a4fc26e45367 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:23.938539 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566b72f-0980-49a0-aeab-a4fc26e45367 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:23.939063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566b72f-0980-49a0-aeab-a4fc26e45367 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:23.941626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2566b72f-0980-49a0-aeab-a4fc26e45367 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:23.957564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 297/598] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:23.958093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:23.959486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566b72f-0980-49a0-aeab-a4fc26e45367 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:24.044420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad585d30-38ac-45d5-9cba-bae66fd0d78b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:24.076542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2566b72f-0980-49a0-aeab-a4fc26e45367 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:24.079503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd46862-5e9d-49e6-bdd3-b3ad08b8d2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:24.080556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd46862-5e9d-49e6-bdd3-b3ad08b8d2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.081025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd46862-5e9d-49e6-bdd3-b3ad08b8d2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.081489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd46862-5e9d-49e6-bdd3-b3ad08b8d2f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.089167 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd46862-5e9d-49e6-bdd3-b3ad08b8d2f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:24.090858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd46862-5e9d-49e6-bdd3-b3ad08b8d2f9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-fbd46862-5e9d-49e6-bdd3-b3ad08b8d2f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:24.105717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:24.106686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:24.107612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:24.107612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:24.107612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:24.107612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:24.107612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:24.107612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:24.107612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:24.107612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:24.110263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 302/599] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:24.111506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd46862-5e9d-49e6-bdd3-b3ad08b8d2f9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:24.116669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cebae9-2624-4426-bb3c-58da7a148c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:24.117442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebae9-2624-4426-bb3c-58da7a148c0f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.117729 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebae9-2624-4426-bb3c-58da7a148c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.118043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cebae9-2624-4426-bb3c-58da7a148c0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.128926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cebae9-2624-4426-bb3c-58da7a148c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:24.130379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cebae9-2624-4426-bb3c-58da7a148c0f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-68cebae9-2624-4426-bb3c-58da7a148c0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:24.148020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:24.148955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:24.154937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:24.154937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:24.154937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:24.154937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:24.154937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 298/600] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:24.154937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d79794-b4bb-43bd-a15b-c2edb576e538 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.154937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d79794-b4bb-43bd-a15b-c2edb576e538 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.154937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d79794-b4bb-43bd-a15b-c2edb576e538 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.154937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 299/601] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:24.155478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d79794-b4bb-43bd-a15b-c2edb576e538 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:24.199460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:24.222741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd46862-5e9d-49e6-bdd3-b3ad08b8d2f9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:24.226242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:24.261413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8b753a-3739-4d22-80be-24da39ce83d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:24.262340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b753a-3739-4d22-80be-24da39ce83d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.262617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b753a-3739-4d22-80be-24da39ce83d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.262885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8b753a-3739-4d22-80be-24da39ce83d9 None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/e08e18aa7d0941f9892986e737ba9e98/roles/94ab939081724a88a65a1961cc1826b8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.263702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d79794-b4bb-43bd-a15b-c2edb576e538 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:24.280763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b753a-3739-4d22-80be-24da39ce83d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=e08e18aa7d0941f9892986e737ba9e98, role_id=94ab939081724a88a65a1961cc1826b8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:24.282167 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8b753a-3739-4d22-80be-24da39ce83d9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:24.299669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566bd07-34c3-43e8-90c8-1e9a04a1c393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:24.300329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566bd07-34c3-43e8-90c8-1e9a04a1c393 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.300645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566bd07-34c3-43e8-90c8-1e9a04a1c393 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.300921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566bd07-34c3-43e8-90c8-1e9a04a1c393 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.301730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566bd07-34c3-43e8-90c8-1e9a04a1c393 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:24.302041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566bd07-34c3-43e8-90c8-1e9a04a1c393 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:24.303589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566bd07-34c3-43e8-90c8-1e9a04a1c393 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:24.315395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 300/602] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:24.316167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566bd07-34c3-43e8-90c8-1e9a04a1c393 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:24.351267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 303/603] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:16:24 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/e08e18aa7d0941f9892986e737ba9e98/roles/94ab939081724a88a65a1961cc1826b8 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:16:24.353341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae55cc-65d7-4de0-ade4-e2e6e89d5a32 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.353862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae55cc-65d7-4de0-ade4-e2e6e89d5a32 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.354390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae55cc-65d7-4de0-ade4-e2e6e89d5a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.365663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:24.393347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9bae55cc-65d7-4de0-ade4-e2e6e89d5a32 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:24.394611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9bae55cc-65d7-4de0-ade4-e2e6e89d5a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:24.442533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566bd07-34c3-43e8-90c8-1e9a04a1c393 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:24.478257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 304/604] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:24.479322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae55cc-65d7-4de0-ade4-e2e6e89d5a32 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:24.484505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63614fd0-a5f7-43c5-ac18-36d43609fef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:24.485439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63614fd0-a5f7-43c5-ac18-36d43609fef4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.485886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63614fd0-a5f7-43c5-ac18-36d43609fef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.486322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63614fd0-a5f7-43c5-ac18-36d43609fef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.487262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63614fd0-a5f7-43c5-ac18-36d43609fef4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:24.487718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63614fd0-a5f7-43c5-ac18-36d43609fef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:24.489297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63614fd0-a5f7-43c5-ac18-36d43609fef4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:24.507301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 301/605] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:24.516245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63614fd0-a5f7-43c5-ac18-36d43609fef4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:24.567139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:24.607573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae55cc-65d7-4de0-ade4-e2e6e89d5a32 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:24.640455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63614fd0-a5f7-43c5-ac18-36d43609fef4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:24.642287 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:24.642407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfdb61-3703-466c-8057-c3262277489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:24.643384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfdb61-3703-466c-8057-c3262277489a None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.643735 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfdb61-3703-466c-8057-c3262277489a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.644078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abfdb61-3703-466c-8057-c3262277489a None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/3a06a84967694e68a3a77bf29f16ee3b/roles/94ab939081724a88a65a1961cc1826b8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.659495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfdb61-3703-466c-8057-c3262277489a None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=3a06a84967694e68a3a77bf29f16ee3b, role_id=94ab939081724a88a65a1961cc1826b8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:24.660976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abfdb61-3703-466c-8057-c3262277489a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:24.682730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f451b01-aea8-4c76-a7d1-11d66e491a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:24.683541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f451b01-aea8-4c76-a7d1-11d66e491a56 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.683826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f451b01-aea8-4c76-a7d1-11d66e491a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.684106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f451b01-aea8-4c76-a7d1-11d66e491a56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.695543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f451b01-aea8-4c76-a7d1-11d66e491a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-3f451b01-aea8-4c76-a7d1-11d66e491a56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:24.703375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:24.704353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:24.705466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:24.709961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 302/606] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:24.710819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f451b01-aea8-4c76-a7d1-11d66e491a56 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:24.746933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 305/607] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:16:24 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/3a06a84967694e68a3a77bf29f16ee3b/roles/94ab939081724a88a65a1961cc1826b8 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:16:24.748300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfdb61-3703-466c-8057-c3262277489a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:24.883940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abfdb61-3703-466c-8057-c3262277489a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:24.910827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:24.914918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f451b01-aea8-4c76-a7d1-11d66e491a56 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:24.930855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484944a-c7e8-4414-b457-e3c324a681d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:24.931820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484944a-c7e8-4414-b457-e3c324a681d5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.932281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484944a-c7e8-4414-b457-e3c324a681d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.932736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484944a-c7e8-4414-b457-e3c324a681d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.933656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484944a-c7e8-4414-b457-e3c324a681d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:24.934118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484944a-c7e8-4414-b457-e3c324a681d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:24.936750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484944a-c7e8-4414-b457-e3c324a681d5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:24.947455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 306/608] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:24.953856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484944a-c7e8-4414-b457-e3c324a681d5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:24.976134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d1f12-6ea1-4a56-aa57-ea86e6d02105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:24.976971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d1f12-6ea1-4a56-aa57-ea86e6d02105 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:24.977537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d1f12-6ea1-4a56-aa57-ea86e6d02105 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:24.977825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408d1f12-6ea1-4a56-aa57-ea86e6d02105 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:24.986710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d1f12-6ea1-4a56-aa57-ea86e6d02105 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:24.988451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408d1f12-6ea1-4a56-aa57-ea86e6d02105 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-408d1f12-6ea1-4a56-aa57-ea86e6d02105 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:25.008903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:25.010098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:25.011231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:25.011231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:25.011231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:25.011231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:25.011231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:25.011231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:25.011231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:25.011231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:25.011231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 303/609] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:25.017583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d1f12-6ea1-4a56-aa57-ea86e6d02105 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:25.052882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:25.079502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484944a-c7e8-4414-b457-e3c324a681d5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:25.125825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901c9f-989b-41ab-a0b7-bb324598836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:25.127018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901c9f-989b-41ab-a0b7-bb324598836c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:25.127944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901c9f-989b-41ab-a0b7-bb324598836c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:25.128436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c901c9f-989b-41ab-a0b7-bb324598836c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:25.140011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408d1f12-6ea1-4a56-aa57-ea86e6d02105 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:25.143788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901c9f-989b-41ab-a0b7-bb324598836c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:25.145545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c901c9f-989b-41ab-a0b7-bb324598836c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-8c901c9f-989b-41ab-a0b7-bb324598836c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:25.169332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:25.170295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:25.171207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:25.171207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:25.171207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:25.171207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:25.173827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 307/610] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:25.182133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901c9f-989b-41ab-a0b7-bb324598836c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:25.192030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b13e1-f2f2-4e14-b59c-bda761781345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:25.192728 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b13e1-f2f2-4e14-b59c-bda761781345 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:25.193063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b13e1-f2f2-4e14-b59c-bda761781345 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:25.193420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b13e1-f2f2-4e14-b59c-bda761781345 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:25.194276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b13e1-f2f2-4e14-b59c-bda761781345 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:25.194587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b13e1-f2f2-4e14-b59c-bda761781345 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:25.196017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b13e1-f2f2-4e14-b59c-bda761781345 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:25.220333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 304/611] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:25.226803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b13e1-f2f2-4e14-b59c-bda761781345 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:25.252855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:25.383930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c901c9f-989b-41ab-a0b7-bb324598836c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:25.397321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:25.430847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b13e1-f2f2-4e14-b59c-bda761781345 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:25.452695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c02a3-571f-4f0d-8718-3d272ea79635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:25.453363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c02a3-571f-4f0d-8718-3d272ea79635 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:25.453642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c02a3-571f-4f0d-8718-3d272ea79635 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:25.453915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c02a3-571f-4f0d-8718-3d272ea79635 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:25.454641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c02a3-571f-4f0d-8718-3d272ea79635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:25.454947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c02a3-571f-4f0d-8718-3d272ea79635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:25.456335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c02a3-571f-4f0d-8718-3d272ea79635 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:25.480571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 308/612] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:25.485832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c02a3-571f-4f0d-8718-3d272ea79635 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:25.499412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a7a51-cc84-4795-ade1-a44e3bf9e4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:25.500308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a7a51-cc84-4795-ade1-a44e3bf9e4fa None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:25.500623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a7a51-cc84-4795-ade1-a44e3bf9e4fa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:25.500898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a7a51-cc84-4795-ade1-a44e3bf9e4fa None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/a5f94913ac8a463db617fbe30df395b1/roles/94ab939081724a88a65a1961cc1826b8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:25.526424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a7a51-cc84-4795-ade1-a44e3bf9e4fa None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=a5f94913ac8a463db617fbe30df395b1, role_id=94ab939081724a88a65a1961cc1826b8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:25.529052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a7a51-cc84-4795-ade1-a44e3bf9e4fa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:25.588710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 305/613] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:16:25 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/a5f94913ac8a463db617fbe30df395b1/roles/94ab939081724a88a65a1961cc1826b8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:16:25.590442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8fd7d-4cc9-41db-a4cd-fbf4d1134c56 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:25.590729 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8fd7d-4cc9-41db-a4cd-fbf4d1134c56 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:25.591005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8fd7d-4cc9-41db-a4cd-fbf4d1134c56 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:25.596587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 306/614] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:25.598764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd24a-6d04-4c99-ac27-cf26ca2ae9c7 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:25.599132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd24a-6d04-4c99-ac27-cf26ca2ae9c7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:25.600050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abd24a-6d04-4c99-ac27-cf26ca2ae9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:25.611472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:25.622511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c02a3-571f-4f0d-8718-3d272ea79635 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:25.623455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-76abd24a-6d04-4c99-ac27-cf26ca2ae9c7 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:25.625204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-76abd24a-6d04-4c99-ac27-cf26ca2ae9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:25.701650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed4e2-3d44-42b9-a2de-2213c3b7f383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:25.702473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed4e2-3d44-42b9-a2de-2213c3b7f383 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:25.702758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed4e2-3d44-42b9-a2de-2213c3b7f383 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:25.703033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeed4e2-3d44-42b9-a2de-2213c3b7f383 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:25.711935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 307/615] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:25.722058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeed4e2-3d44-42b9-a2de-2213c3b7f383 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:25.723610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeed4e2-3d44-42b9-a2de-2213c3b7f383 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:25.738733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abd24a-6d04-4c99-ac27-cf26ca2ae9c7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-daeed4e2-3d44-42b9-a2de-2213c3b7f383 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:25.751718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:25.752976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:25.754116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 309/616] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:25.759322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed4e2-3d44-42b9-a2de-2213c3b7f383 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:25.824843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:25.863865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abd24a-6d04-4c99-ac27-cf26ca2ae9c7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:25.905990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c671ba-5f26-463b-8e54-5a71b22e08c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:25.906980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c671ba-5f26-463b-8e54-5a71b22e08c8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:25.907263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c671ba-5f26-463b-8e54-5a71b22e08c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:25.907533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c671ba-5f26-463b-8e54-5a71b22e08c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:25.921048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c671ba-5f26-463b-8e54-5a71b22e08c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-11c671ba-5f26-463b-8e54-5a71b22e08c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:25.932240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:25.933227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:25.934241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:25.936355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 308/617] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:25.943041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c671ba-5f26-463b-8e54-5a71b22e08c8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:25.983701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeed4e2-3d44-42b9-a2de-2213c3b7f383 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:26.019397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0922b6-9d2d-4f20-8d41-1970cd586b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:26.020056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0922b6-9d2d-4f20-8d41-1970cd586b60 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:26.020394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0922b6-9d2d-4f20-8d41-1970cd586b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:26.020703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0922b6-9d2d-4f20-8d41-1970cd586b60 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:26.021620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0922b6-9d2d-4f20-8d41-1970cd586b60 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:26.021930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0922b6-9d2d-4f20-8d41-1970cd586b60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:26.023378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0922b6-9d2d-4f20-8d41-1970cd586b60 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:26.042040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 310/618] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 07:16:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:26.047210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0922b6-9d2d-4f20-8d41-1970cd586b60 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:26.063648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:26.071571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c671ba-5f26-463b-8e54-5a71b22e08c8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:26.096315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:26.110843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe681fd-3030-495c-9788-316bb544d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:26.111809 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe681fd-3030-495c-9788-316bb544d077 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:26.112233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe681fd-3030-495c-9788-316bb544d077 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:26.112733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe681fd-3030-495c-9788-316bb544d077 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:26.120305 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe681fd-3030-495c-9788-316bb544d077 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:26.120903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe681fd-3030-495c-9788-316bb544d077 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:26.122748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe681fd-3030-495c-9788-316bb544d077 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:26.136406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 309/619] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:26.142223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe681fd-3030-495c-9788-316bb544d077 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:26.160855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0922b6-9d2d-4f20-8d41-1970cd586b60 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:26.200023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a0dad-4708-49be-a4ea-1feb554453d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:26.200857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0dad-4708-49be-a4ea-1feb554453d9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:26.201139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0dad-4708-49be-a4ea-1feb554453d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:26.201415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82a0dad-4708-49be-a4ea-1feb554453d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:26.213222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a0dad-4708-49be-a4ea-1feb554453d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:26.214803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82a0dad-4708-49be-a4ea-1feb554453d9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a82a0dad-4708-49be-a4ea-1feb554453d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:26.237981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:26.238932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:26.239824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:26.239824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:26.239824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:26.239824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:26.239824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 311/620] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:26.246131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a0dad-4708-49be-a4ea-1feb554453d9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:26.279830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe681fd-3030-495c-9788-316bb544d077 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:26.318571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0620d-6565-4ee8-ab6c-5af5ce9b3eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:26.319769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0620d-6565-4ee8-ab6c-5af5ce9b3eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:26.320271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0620d-6565-4ee8-ab6c-5af5ce9b3eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:26.320766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0620d-6565-4ee8-ab6c-5af5ce9b3eb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:26.329734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:26.334601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0620d-6565-4ee8-ab6c-5af5ce9b3eb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:26.336272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0620d-6565-4ee8-ab6c-5af5ce9b3eb2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-12d0620d-6565-4ee8-ab6c-5af5ce9b3eb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:26.355139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:26.356269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:26.357504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:26.357504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:26.357504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:26.357504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:26.359512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 310/621] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:26.365377 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0620d-6565-4ee8-ab6c-5af5ce9b3eb2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:26.377236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82a0dad-4708-49be-a4ea-1feb554453d9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:26.404652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:26.427305 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133bfd7-5a04-4fda-ba10-ef0a780a182d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:26.428254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133bfd7-5a04-4fda-ba10-ef0a780a182d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:26.428709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133bfd7-5a04-4fda-ba10-ef0a780a182d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:26.429131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6133bfd7-5a04-4fda-ba10-ef0a780a182d None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:26.430082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133bfd7-5a04-4fda-ba10-ef0a780a182d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:26.430544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133bfd7-5a04-4fda-ba10-ef0a780a182d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:26.432106 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6133bfd7-5a04-4fda-ba10-ef0a780a182d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:26.460778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 312/622] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:26.461638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133bfd7-5a04-4fda-ba10-ef0a780a182d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:26.476831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0620d-6565-4ee8-ab6c-5af5ce9b3eb2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:26.523850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55b6e-ca22-4be8-9e1e-26ad4661ba97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:26.524435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55b6e-ca22-4be8-9e1e-26ad4661ba97 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:26.528946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55b6e-ca22-4be8-9e1e-26ad4661ba97 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:26.529227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb55b6e-ca22-4be8-9e1e-26ad4661ba97 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:26.529961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55b6e-ca22-4be8-9e1e-26ad4661ba97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:26.530267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55b6e-ca22-4be8-9e1e-26ad4661ba97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:26.531644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb55b6e-ca22-4be8-9e1e-26ad4661ba97 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:26.551733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 311/623] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:26.558212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55b6e-ca22-4be8-9e1e-26ad4661ba97 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:26.627319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6133bfd7-5a04-4fda-ba10-ef0a780a182d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:26.655075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:26.667310 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936a012-0047-4a83-ae32-ba535421b77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:26.668383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936a012-0047-4a83-ae32-ba535421b77e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:26.668694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936a012-0047-4a83-ae32-ba535421b77e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:26.669003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8936a012-0047-4a83-ae32-ba535421b77e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:26.677116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936a012-0047-4a83-ae32-ba535421b77e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:26.679486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8936a012-0047-4a83-ae32-ba535421b77e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-8936a012-0047-4a83-ae32-ba535421b77e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:26.696821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:26.697816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:26.698709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:26.698709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:26.698709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:26.698709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:26.698709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:26.698709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:26.698709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:26.698709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:26.698709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 313/624] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:26.705369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936a012-0047-4a83-ae32-ba535421b77e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:26.801879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:26.812562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb55b6e-ca22-4be8-9e1e-26ad4661ba97 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:26.842419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8936a012-0047-4a83-ae32-ba535421b77e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:26.878536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281039f-93db-40f0-a896-ddb4df593e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:26.879338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281039f-93db-40f0-a896-ddb4df593e4c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:26.879617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281039f-93db-40f0-a896-ddb4df593e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:26.879890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7281039f-93db-40f0-a896-ddb4df593e4c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:26.889356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281039f-93db-40f0-a896-ddb4df593e4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:26.891045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7281039f-93db-40f0-a896-ddb4df593e4c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7281039f-93db-40f0-a896-ddb4df593e4c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:26.908665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:26.909699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:26.910663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 312/625] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:26.916045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281039f-93db-40f0-a896-ddb4df593e4c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:26.923634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647700bd-3161-4203-845c-7d5092a32aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:26.924694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647700bd-3161-4203-845c-7d5092a32aac None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:26.925231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647700bd-3161-4203-845c-7d5092a32aac None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:26.925707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647700bd-3161-4203-845c-7d5092a32aac None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:26.926719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647700bd-3161-4203-845c-7d5092a32aac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:26.927309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647700bd-3161-4203-845c-7d5092a32aac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:26.929674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647700bd-3161-4203-845c-7d5092a32aac None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:26.950767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 314/626] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:26.957309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647700bd-3161-4203-845c-7d5092a32aac None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:27.044505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7281039f-93db-40f0-a896-ddb4df593e4c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:27.056150 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:27.086070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead7f6f-ef5b-41bb-89b3-e267d4bd1d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:27.087698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead7f6f-ef5b-41bb-89b3-e267d4bd1d3f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.088301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead7f6f-ef5b-41bb-89b3-e267d4bd1d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.088789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead7f6f-ef5b-41bb-89b3-e267d4bd1d3f None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.090164 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead7f6f-ef5b-41bb-89b3-e267d4bd1d3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:27.090724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead7f6f-ef5b-41bb-89b3-e267d4bd1d3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:27.092779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead7f6f-ef5b-41bb-89b3-e267d4bd1d3f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:27.131119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 313/627] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 07:16:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:27.135796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e4e64-5c69-473b-be19-9b5ae2ca2872 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.136093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e4e64-5c69-473b-be19-9b5ae2ca2872 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.136377 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151e4e64-5c69-473b-be19-9b5ae2ca2872 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.137818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 314/628] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:27.138475 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e4e64-5c69-473b-be19-9b5ae2ca2872 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:27.142942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647700bd-3161-4203-845c-7d5092a32aac None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:27.168872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:27.178907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cab5af-4b45-4727-854c-a2397c261f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:27.179913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cab5af-4b45-4727-854c-a2397c261f0a None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.180295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cab5af-4b45-4727-854c-a2397c261f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.180701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cab5af-4b45-4727-854c-a2397c261f0a None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/b54767b9f07341c3aa2ba9a120a62ed0/roles/94ab939081724a88a65a1961cc1826b8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.195762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cab5af-4b45-4727-854c-a2397c261f0a None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=b54767b9f07341c3aa2ba9a120a62ed0, role_id=94ab939081724a88a65a1961cc1826b8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:27.197558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cab5af-4b45-4727-854c-a2397c261f0a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:27.252603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151e4e64-5c69-473b-be19-9b5ae2ca2872 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:27.268056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 315/629] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:16:26 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/b54767b9f07341c3aa2ba9a120a62ed0/roles/94ab939081724a88a65a1961cc1826b8 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:16:27.269887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eab180-afb4-495a-aa9f-2c3e5e807862 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.270419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eab180-afb4-495a-aa9f-2c3e5e807862 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.270952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eab180-afb4-495a-aa9f-2c3e5e807862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.293021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e1eab180-afb4-495a-aa9f-2c3e5e807862 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:27.295254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e1eab180-afb4-495a-aa9f-2c3e5e807862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:27.312375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63aad63-c39d-454d-b5f4-dc9a498338c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:27.313037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aad63-c39d-454d-b5f4-dc9a498338c5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.313321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aad63-c39d-454d-b5f4-dc9a498338c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.313648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63aad63-c39d-454d-b5f4-dc9a498338c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.385528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 316/630] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:27.412867 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eab180-afb4-495a-aa9f-2c3e5e807862 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:27.437094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aad63-c39d-454d-b5f4-dc9a498338c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:27.438677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63aad63-c39d-454d-b5f4-dc9a498338c5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:27.450374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:27.460863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:27.540546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eab180-afb4-495a-aa9f-2c3e5e807862 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:27.551086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 315/631] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:27.556854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076cf3-8118-44c0-9195-14232331eb39 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.557534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076cf3-8118-44c0-9195-14232331eb39 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.557534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f076cf3-8118-44c0-9195-14232331eb39 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.563588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 316/632] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:27.563588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f076cf3-8118-44c0-9195-14232331eb39 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:27.584806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d13648-ffe9-4076-8dcf-69b1afb86ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:27.585621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13648-ffe9-4076-8dcf-69b1afb86ebe None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.585904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13648-ffe9-4076-8dcf-69b1afb86ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.586179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d13648-ffe9-4076-8dcf-69b1afb86ebe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.598185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d13648-ffe9-4076-8dcf-69b1afb86ebe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-54d13648-ffe9-4076-8dcf-69b1afb86ebe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:27.607063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:27.608014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:27.608882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 317/633] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:27.610063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee47b9-7469-4a34-984d-c013873d0d6e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.610063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee47b9-7469-4a34-984d-c013873d0d6e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.610343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee47b9-7469-4a34-984d-c013873d0d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.632898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-99ee47b9-7469-4a34-984d-c013873d0d6e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:27.634750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-99ee47b9-7469-4a34-984d-c013873d0d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:27.669715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f076cf3-8118-44c0-9195-14232331eb39 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:27.685218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:27.706309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4859dc-3b1a-4181-b66b-f4474b2a4cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:27.707190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4859dc-3b1a-4181-b66b-f4474b2a4cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.707536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4859dc-3b1a-4181-b66b-f4474b2a4cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.707876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4859dc-3b1a-4181-b66b-f4474b2a4cc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.720559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4859dc-3b1a-4181-b66b-f4474b2a4cc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:27.722191 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4859dc-3b1a-4181-b66b-f4474b2a4cc8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:27.727267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 318/634] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:27.728126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee47b9-7469-4a34-984d-c013873d0d6e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:27.744725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8f4859dc-3b1a-4181-b66b-f4474b2a4cc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:27.759102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:27.765903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:27.766795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:27.766795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:27.766795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:27.766795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:27.766795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 317/635] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:27.766795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4859dc-3b1a-4181-b66b-f4474b2a4cc8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:27.842156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee47b9-7469-4a34-984d-c013873d0d6e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:27.878400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3e331-9522-4520-9ba1-b7dc8e5b36cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:27.879067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3e331-9522-4520-9ba1-b7dc8e5b36cd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.879343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3e331-9522-4520-9ba1-b7dc8e5b36cd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.879615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3e331-9522-4520-9ba1-b7dc8e5b36cd None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.880356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3e331-9522-4520-9ba1-b7dc8e5b36cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:27.881536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3e331-9522-4520-9ba1-b7dc8e5b36cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:27.882935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3e331-9522-4520-9ba1-b7dc8e5b36cd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:27.891935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 319/636] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:27.892863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3e331-9522-4520-9ba1-b7dc8e5b36cd None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:27.910563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4859dc-3b1a-4181-b66b-f4474b2a4cc8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:27.949695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449aff2-1025-4fac-9906-f51923a73b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:27.950357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449aff2-1025-4fac-9906-f51923a73b93 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:27.950633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449aff2-1025-4fac-9906-f51923a73b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:27.950902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449aff2-1025-4fac-9906-f51923a73b93 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:27.951627 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449aff2-1025-4fac-9906-f51923a73b93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:27.951929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449aff2-1025-4fac-9906-f51923a73b93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:27.953306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e449aff2-1025-4fac-9906-f51923a73b93 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:27.971213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 318/637] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:27.972114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449aff2-1025-4fac-9906-f51923a73b93 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:27.997931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:28.001841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:28.031568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3e331-9522-4520-9ba1-b7dc8e5b36cd None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.075048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c1e1-0681-444f-b017-7699b8f8ab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.076505 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c1e1-0681-444f-b017-7699b8f8ab07 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.076802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c1e1-0681-444f-b017-7699b8f8ab07 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.077081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758c1e1-0681-444f-b017-7699b8f8ab07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.081460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e449aff2-1025-4fac-9906-f51923a73b93 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.093601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758c1e1-0681-444f-b017-7699b8f8ab07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c758c1e1-0681-444f-b017-7699b8f8ab07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:28.104704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:28.106162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:28.107496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 320/638] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:28.108783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c1e1-0681-444f-b017-7699b8f8ab07 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:28.127728 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecf9dc-b5ba-454c-b674-aa332234c2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.128695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecf9dc-b5ba-454c-b674-aa332234c2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.129106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecf9dc-b5ba-454c-b674-aa332234c2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.129505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ecf9dc-b5ba-454c-b674-aa332234c2f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.141315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecf9dc-b5ba-454c-b674-aa332234c2f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:28.142903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ecf9dc-b5ba-454c-b674-aa332234c2f5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b0ecf9dc-b5ba-454c-b674-aa332234c2f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:28.163033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:28.164869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:28.167020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:28.167020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:28.167020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:28.167020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:28.167020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 319/639] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:28.167020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecf9dc-b5ba-454c-b674-aa332234c2f5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:28.231026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758c1e1-0681-444f-b017-7699b8f8ab07 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.270042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:28.280775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5226c-bdd5-4eef-8cd0-beae0f3fc687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.282163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5226c-bdd5-4eef-8cd0-beae0f3fc687 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.282447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5226c-bdd5-4eef-8cd0-beae0f3fc687 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.283007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5226c-bdd5-4eef-8cd0-beae0f3fc687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.286590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:28.294770 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5226c-bdd5-4eef-8cd0-beae0f3fc687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:28.294988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ecf9dc-b5ba-454c-b674-aa332234c2f5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.296398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5226c-bdd5-4eef-8cd0-beae0f3fc687 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-cfb5226c-bdd5-4eef-8cd0-beae0f3fc687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:28.317047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:28.319793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 321/640] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:28.321934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5226c-bdd5-4eef-8cd0-beae0f3fc687 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:28.335469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929dd8d-4f96-47a9-a0be-09cf9a3651a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.336151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929dd8d-4f96-47a9-a0be-09cf9a3651a3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.336511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929dd8d-4f96-47a9-a0be-09cf9a3651a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.336807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929dd8d-4f96-47a9-a0be-09cf9a3651a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.337933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929dd8d-4f96-47a9-a0be-09cf9a3651a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:28.338246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929dd8d-4f96-47a9-a0be-09cf9a3651a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:28.340248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929dd8d-4f96-47a9-a0be-09cf9a3651a3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:28.351773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 320/641] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:28.352546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929dd8d-4f96-47a9-a0be-09cf9a3651a3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:28.438208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5226c-bdd5-4eef-8cd0-beae0f3fc687 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.473088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929dd8d-4f96-47a9-a0be-09cf9a3651a3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.477028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d2ba-0aa4-41c1-8f0c-06b37fc0a697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.477703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d2ba-0aa4-41c1-8f0c-06b37fc0a697 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.478036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d2ba-0aa4-41c1-8f0c-06b37fc0a697 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.478318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a38d2ba-0aa4-41c1-8f0c-06b37fc0a697 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.479066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d2ba-0aa4-41c1-8f0c-06b37fc0a697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:28.479376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d2ba-0aa4-41c1-8f0c-06b37fc0a697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:28.481189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a38d2ba-0aa4-41c1-8f0c-06b37fc0a697 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:28.493387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 322/642] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:28.494197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d2ba-0aa4-41c1-8f0c-06b37fc0a697 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:28.513916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6213c016-16b7-4ff0-a1ff-4ac97fee05ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.514976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213c016-16b7-4ff0-a1ff-4ac97fee05ac None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.515545 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213c016-16b7-4ff0-a1ff-4ac97fee05ac None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.515996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6213c016-16b7-4ff0-a1ff-4ac97fee05ac None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.517009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213c016-16b7-4ff0-a1ff-4ac97fee05ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:28.517496 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213c016-16b7-4ff0-a1ff-4ac97fee05ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:28.519286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6213c016-16b7-4ff0-a1ff-4ac97fee05ac None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:28.530079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:28.538874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 321/643] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:28.538874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371841a9-04e1-45e6-83eb-9d496ca7bea2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.538874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371841a9-04e1-45e6-83eb-9d496ca7bea2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.538874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371841a9-04e1-45e6-83eb-9d496ca7bea2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.538874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 322/644] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:28.538874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371841a9-04e1-45e6-83eb-9d496ca7bea2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:28.558349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:28.611384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a38d2ba-0aa4-41c1-8f0c-06b37fc0a697 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.653908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371841a9-04e1-45e6-83eb-9d496ca7bea2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.655610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38023d-b6a7-456d-9f7e-2cb98b165e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.656586 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38023d-b6a7-456d-9f7e-2cb98b165e45 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.656872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38023d-b6a7-456d-9f7e-2cb98b165e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.657150 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38023d-b6a7-456d-9f7e-2cb98b165e45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.669251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38023d-b6a7-456d-9f7e-2cb98b165e45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:28.670883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb38023d-b6a7-456d-9f7e-2cb98b165e45 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:28.688383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8c1ba-668a-4cdb-98e1-7410cb5e4818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.689214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8c1ba-668a-4cdb-98e1-7410cb5e4818 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.689495 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8c1ba-668a-4cdb-98e1-7410cb5e4818 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.689769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8c1ba-668a-4cdb-98e1-7410cb5e4818 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-cb38023d-b6a7-456d-9f7e-2cb98b165e45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:28.690038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:28.690896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:28.691981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:28.691981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:28.691981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:28.691981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:28.696246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 323/645] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:28.696906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38023d-b6a7-456d-9f7e-2cb98b165e45 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:28.698531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8c1ba-668a-4cdb-98e1-7410cb5e4818 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:28.699985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8c1ba-668a-4cdb-98e1-7410cb5e4818 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e9a8c1ba-668a-4cdb-98e1-7410cb5e4818 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:28.715389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:28.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:28.718198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 323/646] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:28.718810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344acb-c349-4c99-80d3-92455ddf9ab9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.718810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344acb-c349-4c99-80d3-92455ddf9ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.718941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344acb-c349-4c99-80d3-92455ddf9ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.736515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e2344acb-c349-4c99-80d3-92455ddf9ab9 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:28.737716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e2344acb-c349-4c99-80d3-92455ddf9ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:28.796847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:28.805278 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38023d-b6a7-456d-9f7e-2cb98b165e45 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.820501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 324/647] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:28.820501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2344acb-c349-4c99-80d3-92455ddf9ab9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:28.823216 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:28.851305 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccd9c0-95a7-45cd-b0f0-79bbca560441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.851960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccd9c0-95a7-45cd-b0f0-79bbca560441 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.852242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccd9c0-95a7-45cd-b0f0-79bbca560441 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.852572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccccd9c0-95a7-45cd-b0f0-79bbca560441 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:28.853612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccd9c0-95a7-45cd-b0f0-79bbca560441 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=451754f5553e4b9783b4e75f6d408ab6) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:28.854098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccd9c0-95a7-45cd-b0f0-79bbca560441 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:28.855920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccccd9c0-95a7-45cd-b0f0-79bbca560441 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:28.862169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 324/648] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:28 2022] GET /identity/v3/role_assignments?user.id=451754f5553e4b9783b4e75f6d408ab6&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:28.862898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccd9c0-95a7-45cd-b0f0-79bbca560441 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:28.946213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2344acb-c349-4c99-80d3-92455ddf9ab9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:28.996505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b0d2e-b1b5-4313-bcf3-2439586500f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:28.997693 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b0d2e-b1b5-4313-bcf3-2439586500f9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:28.998131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b0d2e-b1b5-4313-bcf3-2439586500f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:28.998793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b0d2e-b1b5-4313-bcf3-2439586500f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.000223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b0d2e-b1b5-4313-bcf3-2439586500f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:29.000984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b0d2e-b1b5-4313-bcf3-2439586500f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:29.003292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b0d2e-b1b5-4313-bcf3-2439586500f9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:29.006815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccccd9c0-95a7-45cd-b0f0-79bbca560441 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:29.023816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 325/649] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:29.025439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b0d2e-b1b5-4313-bcf3-2439586500f9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:29.057086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6c034-1ee0-45a0-9579-506fdcc36d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:29.058342 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6c034-1ee0-45a0-9579-506fdcc36d1b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:29.058628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6c034-1ee0-45a0-9579-506fdcc36d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:29.058907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6c034-1ee0-45a0-9579-506fdcc36d1b None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.060055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6c034-1ee0-45a0-9579-506fdcc36d1b None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:29.060379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6c034-1ee0-45a0-9579-506fdcc36d1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:29.062211 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa6c034-1ee0-45a0-9579-506fdcc36d1b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:29.090162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 325/650] 10.222.0.24 () {56 vars in 1137 bytes} [Wed May 25 07:16:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:29.091394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6c034-1ee0-45a0-9579-506fdcc36d1b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:29.100940 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:29.128990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:29.173320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b0d2e-b1b5-4313-bcf3-2439586500f9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:29.212467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354b1b-2fe6-475c-87a7-3173ab75ed4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:29.213286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354b1b-2fe6-475c-87a7-3173ab75ed4c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:29.213577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354b1b-2fe6-475c-87a7-3173ab75ed4c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:29.213844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83354b1b-2fe6-475c-87a7-3173ab75ed4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.221386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa6c034-1ee0-45a0-9579-506fdcc36d1b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:29.226320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83354b1b-2fe6-475c-87a7-3173ab75ed4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-83354b1b-2fe6-475c-87a7-3173ab75ed4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:29.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:29.235579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:29.236431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 326/651] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:29.237165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354b1b-2fe6-475c-87a7-3173ab75ed4c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:29.271018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69af285-08a5-4e2e-87bc-9bd58ca5741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:29.273455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69af285-08a5-4e2e-87bc-9bd58ca5741a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:29.273955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69af285-08a5-4e2e-87bc-9bd58ca5741a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:29.274654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69af285-08a5-4e2e-87bc-9bd58ca5741a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.288405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69af285-08a5-4e2e-87bc-9bd58ca5741a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:29.290828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69af285-08a5-4e2e-87bc-9bd58ca5741a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-d69af285-08a5-4e2e-87bc-9bd58ca5741a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:29.312653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:29.313668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:29.314631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:29.317206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 326/652] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 07:16:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:29.322188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69af285-08a5-4e2e-87bc-9bd58ca5741a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:29.363897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83354b1b-2fe6-475c-87a7-3173ab75ed4c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:29.375856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:29.401664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fc1e4-7fa8-414f-ae46-a91418f10300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:29.402239 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fc1e4-7fa8-414f-ae46-a91418f10300 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:29.402522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fc1e4-7fa8-414f-ae46-a91418f10300 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:29.402798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fc1e4-7fa8-414f-ae46-a91418f10300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.443051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:29.453083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69af285-08a5-4e2e-87bc-9bd58ca5741a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:29.492688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fc1e4-7fa8-414f-ae46-a91418f10300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:29.494154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66fc1e4-7fa8-414f-ae46-a91418f10300 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:29.495325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f71a-6dd9-4ba7-b48c-1e2b1e78abd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:29.496667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f71a-6dd9-4ba7-b48c-1e2b1e78abd2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:29.498212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f71a-6dd9-4ba7-b48c-1e2b1e78abd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:29.498791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1722f71a-6dd9-4ba7-b48c-1e2b1e78abd2 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.499875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f71a-6dd9-4ba7-b48c-1e2b1e78abd2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:29.500493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f71a-6dd9-4ba7-b48c-1e2b1e78abd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:29.502187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1722f71a-6dd9-4ba7-b48c-1e2b1e78abd2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:29.515834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 327/653] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:29.517174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f71a-6dd9-4ba7-b48c-1e2b1e78abd2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:29.611339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 327/654] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:29.612205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fc1e4-7fa8-414f-ae46-a91418f10300 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:29.624302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:29.644510 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1722f71a-6dd9-4ba7-b48c-1e2b1e78abd2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:29.683463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6311b41d-3679-42b8-9d23-f1903ef72275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:29.684382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311b41d-3679-42b8-9d23-f1903ef72275 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:29.685031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311b41d-3679-42b8-9d23-f1903ef72275 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:29.685551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6311b41d-3679-42b8-9d23-f1903ef72275 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.686837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311b41d-3679-42b8-9d23-f1903ef72275 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:29.687335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311b41d-3679-42b8-9d23-f1903ef72275 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:29.688970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6311b41d-3679-42b8-9d23-f1903ef72275 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:29.717659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fc1e4-7fa8-414f-ae46-a91418f10300 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:29.755521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5802d1-701e-4711-891d-cdcf0fed5f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:29.756470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5802d1-701e-4711-891d-cdcf0fed5f13 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:29.756802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5802d1-701e-4711-891d-cdcf0fed5f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:29.757077 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5802d1-701e-4711-891d-cdcf0fed5f13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.768607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5802d1-701e-4711-891d-cdcf0fed5f13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:29.770084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5802d1-701e-4711-891d-cdcf0fed5f13 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-4a5802d1-701e-4711-891d-cdcf0fed5f13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:29.789808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:29.790851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:29.797135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:29.797135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:29.797135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:29.797135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:29.797135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 328/655] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:29.797135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5802d1-701e-4711-891d-cdcf0fed5f13 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:29.839819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 328/656] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 07:16:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:29.841343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f58c1-56cd-4645-8b58-48bf742f7171 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:29.841889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f58c1-56cd-4645-8b58-48bf742f7171 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:29.842164 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f58c1-56cd-4645-8b58-48bf742f7171 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.843679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 329/657] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:29.844499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f58c1-56cd-4645-8b58-48bf742f7171 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:29.861050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:29.873649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:29.913412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5802d1-701e-4711-891d-cdcf0fed5f13 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:29.949241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be0ae4-eea4-45ef-92e4-5cb5e8c2e826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:29.950069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be0ae4-eea4-45ef-92e4-5cb5e8c2e826 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:29.950352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be0ae4-eea4-45ef-92e4-5cb5e8c2e826 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:29.950629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be0ae4-eea4-45ef-92e4-5cb5e8c2e826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:29.954162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f58c1-56cd-4645-8b58-48bf742f7171 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:29.961139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be0ae4-eea4-45ef-92e4-5cb5e8c2e826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:29.962600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be0ae4-eea4-45ef-92e4-5cb5e8c2e826 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-91be0ae4-eea4-45ef-92e4-5cb5e8c2e826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:29.981905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:29.983002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:29.983923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:29.983923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:29.983923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:29.983923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:29.983923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 329/658] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:29.983923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be0ae4-eea4-45ef-92e4-5cb5e8c2e826 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.000303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923d568-0a58-4384-8bce-229f6cb086bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.001722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d568-0a58-4384-8bce-229f6cb086bf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.002439 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d568-0a58-4384-8bce-229f6cb086bf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.002855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923d568-0a58-4384-8bce-229f6cb086bf None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.003989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923d568-0a58-4384-8bce-229f6cb086bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:30.004826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923d568-0a58-4384-8bce-229f6cb086bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:30.006921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b923d568-0a58-4384-8bce-229f6cb086bf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:30.023903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 330/659] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:30.025365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c9bd4-cf30-4684-aed3-6e03e323c554 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.025798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c9bd4-cf30-4684-aed3-6e03e323c554 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.026219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c9bd4-cf30-4684-aed3-6e03e323c554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.043668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4c2c9bd4-cf30-4684-aed3-6e03e323c554 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:30.044887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4c2c9bd4-cf30-4684-aed3-6e03e323c554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:30.103887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be0ae4-eea4-45ef-92e4-5cb5e8c2e826 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:30.109675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:30.114330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 331/660] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:30.115601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c9bd4-cf30-4684-aed3-6e03e323c554 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.133298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:30.154951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff9956-d3e2-413f-9925-c593f35f3c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.157020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff9956-d3e2-413f-9925-c593f35f3c7f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.157020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff9956-d3e2-413f-9925-c593f35f3c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.157020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ff9956-d3e2-413f-9925-c593f35f3c7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.231515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff9956-d3e2-413f-9925-c593f35f3c7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:30.232939 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ff9956-d3e2-413f-9925-c593f35f3c7f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:30.234025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c9bd4-cf30-4684-aed3-6e03e323c554 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:30.269737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371b866-1ea0-4f8f-9b4d-caba68814030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.270391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371b866-1ea0-4f8f-9b4d-caba68814030 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.270666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371b866-1ea0-4f8f-9b4d-caba68814030 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.270932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371b866-1ea0-4f8f-9b4d-caba68814030 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.272393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371b866-1ea0-4f8f-9b4d-caba68814030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:30.272953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371b866-1ea0-4f8f-9b4d-caba68814030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:30.274095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c371b866-1ea0-4f8f-9b4d-caba68814030 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:30.285991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 332/661] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:30.286624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371b866-1ea0-4f8f-9b4d-caba68814030 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.346522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 330/662] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:30.347710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff9956-d3e2-413f-9925-c593f35f3c7f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.352585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:30.366561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:30.396525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c371b866-1ea0-4f8f-9b4d-caba68814030 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:30.434752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c6b34-6da6-4092-ba23-730af6166039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.436142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c6b34-6da6-4092-ba23-730af6166039 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.436641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c6b34-6da6-4092-ba23-730af6166039 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.437328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c6b34-6da6-4092-ba23-730af6166039 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.447136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c6b34-6da6-4092-ba23-730af6166039 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:30.449330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99c6b34-6da6-4092-ba23-730af6166039 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:30.455718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ff9956-d3e2-413f-9925-c593f35f3c7f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-d99c6b34-6da6-4092-ba23-730af6166039 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:30.464121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:30.465268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:16:30.466449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:30.468649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 333/663] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:30.469586 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c6b34-6da6-4092-ba23-730af6166039 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.496083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cf847-29be-46f4-99c5-3e402a3512b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.496848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cf847-29be-46f4-99c5-3e402a3512b5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.497126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cf847-29be-46f4-99c5-3e402a3512b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.497397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cf847-29be-46f4-99c5-3e402a3512b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.508443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cf847-29be-46f4-99c5-3e402a3512b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-dc1cf847-29be-46f4-99c5-3e402a3512b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:30.516541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:30.517462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:30.518337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 331/664] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:30.519029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cf847-29be-46f4-99c5-3e402a3512b5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.576740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c6b34-6da6-4092-ba23-730af6166039 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:30.602320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:30.609662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:30.617047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e4ed2-8bbc-4fb7-8c6c-d715fe61581d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.617853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e4ed2-8bbc-4fb7-8c6c-d715fe61581d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.620331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e4ed2-8bbc-4fb7-8c6c-d715fe61581d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.620331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15e4ed2-8bbc-4fb7-8c6c-d715fe61581d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.627211 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e4ed2-8bbc-4fb7-8c6c-d715fe61581d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:30.629433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15e4ed2-8bbc-4fb7-8c6c-d715fe61581d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:30.637957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cf847-29be-46f4-99c5-3e402a3512b5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c15e4ed2-8bbc-4fb7-8c6c-d715fe61581d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:30.648189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:30.649094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:30.649990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:30.649990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:30.649990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:30.649990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:30.649990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:30.649990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:30.649990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:30.649990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:30.649990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 334/665] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:30.651187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e4ed2-8bbc-4fb7-8c6c-d715fe61581d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.678105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649a085-a8ff-46e1-92c5-7691d5235a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.678940 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649a085-a8ff-46e1-92c5-7691d5235a75 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.679182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649a085-a8ff-46e1-92c5-7691d5235a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.679456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d649a085-a8ff-46e1-92c5-7691d5235a75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.690378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649a085-a8ff-46e1-92c5-7691d5235a75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:30.692043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d649a085-a8ff-46e1-92c5-7691d5235a75 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d649a085-a8ff-46e1-92c5-7691d5235a75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:30.710175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:30.711095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:30.711990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:30.711990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:30.711990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:30.711990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:30.711990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 332/666] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:30.712274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649a085-a8ff-46e1-92c5-7691d5235a75 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.761595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15e4ed2-8bbc-4fb7-8c6c-d715fe61581d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:30.795964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959116b-946a-410e-8fd1-9176e0bcff91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.796670 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959116b-946a-410e-8fd1-9176e0bcff91 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.796947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959116b-946a-410e-8fd1-9176e0bcff91 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.797214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b959116b-946a-410e-8fd1-9176e0bcff91 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.798045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959116b-946a-410e-8fd1-9176e0bcff91 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:30.798352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959116b-946a-410e-8fd1-9176e0bcff91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:30.799771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b959116b-946a-410e-8fd1-9176e0bcff91 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:30.818489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 335/667] 10.222.0.24 () {56 vars in 1139 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:30.819143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959116b-946a-410e-8fd1-9176e0bcff91 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.828830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d649a085-a8ff-46e1-92c5-7691d5235a75 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:30.855478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:30.862772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:30.870385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77ecdf-5464-4e96-8c59-6b970ad5a605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.870385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77ecdf-5464-4e96-8c59-6b970ad5a605 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.870385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77ecdf-5464-4e96-8c59-6b970ad5a605 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.870385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77ecdf-5464-4e96-8c59-6b970ad5a605 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.870779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77ecdf-5464-4e96-8c59-6b970ad5a605 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:30.870779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77ecdf-5464-4e96-8c59-6b970ad5a605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:30.870779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77ecdf-5464-4e96-8c59-6b970ad5a605 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:30.878913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 333/668] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:30.884411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77ecdf-5464-4e96-8c59-6b970ad5a605 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.937129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b959116b-946a-410e-8fd1-9176e0bcff91 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:30.972652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99645d-e881-4923-b2ac-bb9321343a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:30.973474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99645d-e881-4923-b2ac-bb9321343a85 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:30.973593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99645d-e881-4923-b2ac-bb9321343a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:30.973859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff99645d-e881-4923-b2ac-bb9321343a85 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:30.974968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99645d-e881-4923-b2ac-bb9321343a85 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:30.975440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99645d-e881-4923-b2ac-bb9321343a85 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:30.976997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff99645d-e881-4923-b2ac-bb9321343a85 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:30.989454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 336/669] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:30.995689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99645d-e881-4923-b2ac-bb9321343a85 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:30.998227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77ecdf-5464-4e96-8c59-6b970ad5a605 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.033507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17ba02-c0e0-4d5b-8809-4ea194499583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.034096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17ba02-c0e0-4d5b-8809-4ea194499583 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.034378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17ba02-c0e0-4d5b-8809-4ea194499583 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.034654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17ba02-c0e0-4d5b-8809-4ea194499583 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.035488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17ba02-c0e0-4d5b-8809-4ea194499583 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:31.035800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17ba02-c0e0-4d5b-8809-4ea194499583 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.037330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac17ba02-c0e0-4d5b-8809-4ea194499583 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.054341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 334/670] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:31.054341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17ba02-c0e0-4d5b-8809-4ea194499583 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:31.106319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:31.113113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:31.122107 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff99645d-e881-4923-b2ac-bb9321343a85 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.152415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd30a5-1480-4c7e-b8c8-7e2e8b830973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.153478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd30a5-1480-4c7e-b8c8-7e2e8b830973 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.153948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd30a5-1480-4c7e-b8c8-7e2e8b830973 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.154409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd30a5-1480-4c7e-b8c8-7e2e8b830973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.160850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17ba02-c0e0-4d5b-8809-4ea194499583 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.198101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e220d4-1c0f-4152-a77c-7c61cf102246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.198976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e220d4-1c0f-4152-a77c-7c61cf102246 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.199476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e220d4-1c0f-4152-a77c-7c61cf102246 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.199817 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e220d4-1c0f-4152-a77c-7c61cf102246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.210584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e220d4-1c0f-4152-a77c-7c61cf102246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.212130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e220d4-1c0f-4152-a77c-7c61cf102246 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a1e220d4-1c0f-4152-a77c-7c61cf102246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:31.230301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:31.231517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:31.232999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:31.232999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:31.232999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:31.232999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:31.232999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 335/671] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:31.233298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e220d4-1c0f-4152-a77c-7c61cf102246 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:31.238001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd30a5-1480-4c7e-b8c8-7e2e8b830973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.239453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd30a5-1480-4c7e-b8c8-7e2e8b830973 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.333020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:31.334804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:31.335937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e220d4-1c0f-4152-a77c-7c61cf102246 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.339303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 337/672] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:31.340241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd30a5-1480-4c7e-b8c8-7e2e8b830973 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:31.370284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de33750-1bca-4492-810d-4f2d6cefc4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.370946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33750-1bca-4492-810d-4f2d6cefc4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.371443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33750-1bca-4492-810d-4f2d6cefc4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.371738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de33750-1bca-4492-810d-4f2d6cefc4b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.372810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de33750-1bca-4492-810d-4f2d6cefc4b2 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=e08e18aa7d0941f9892986e737ba9e98) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:31.373440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de33750-1bca-4492-810d-4f2d6cefc4b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.374921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de33750-1bca-4492-810d-4f2d6cefc4b2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.380719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 336/673] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/role_assignments?user.id=e08e18aa7d0941f9892986e737ba9e98&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:31.381496 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de33750-1bca-4492-810d-4f2d6cefc4b2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:31.448622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd30a5-1480-4c7e-b8c8-7e2e8b830973 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.489709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882ce3a-1809-449d-8968-961f09e20ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.491100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ce3a-1809-449d-8968-961f09e20ccd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.491381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ce3a-1809-449d-8968-961f09e20ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.491653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882ce3a-1809-449d-8968-961f09e20ccd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.499066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882ce3a-1809-449d-8968-961f09e20ccd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.499257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de33750-1bca-4492-810d-4f2d6cefc4b2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.500576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882ce3a-1809-449d-8968-961f09e20ccd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-e882ce3a-1809-449d-8968-961f09e20ccd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:31.515394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:31.516373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:31.517307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:31.517307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:31.517307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:31.517307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:31.517307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:31.517307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:31.517307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:31.517307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:31.517307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 338/674] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:31.518139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b983-b64a-44d2-9a99-61032afb9ad4 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.518235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b983-b64a-44d2-9a99-61032afb9ad4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.518509 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25b983-b64a-44d2-9a99-61032afb9ad4 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.520040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 339/675] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:31.524807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b983-b64a-44d2-9a99-61032afb9ad4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:31.549687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50911399-3727-49f7-bea3-41e1d2430615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.550624 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50911399-3727-49f7-bea3-41e1d2430615 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.551058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50911399-3727-49f7-bea3-41e1d2430615 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.551329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50911399-3727-49f7-bea3-41e1d2430615 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.552065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50911399-3727-49f7-bea3-41e1d2430615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:31.552471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50911399-3727-49f7-bea3-41e1d2430615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.553908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50911399-3727-49f7-bea3-41e1d2430615 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.569114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 337/676] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:31.569114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50911399-3727-49f7-bea3-41e1d2430615 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:31.592722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:31.607341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:31.641067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25b983-b64a-44d2-9a99-61032afb9ad4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.676651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22849b4b-7d4a-449f-9e0a-e93f86f23797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.678119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22849b4b-7d4a-449f-9e0a-e93f86f23797 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.678400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22849b4b-7d4a-449f-9e0a-e93f86f23797 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.678679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22849b4b-7d4a-449f-9e0a-e93f86f23797 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.690316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22849b4b-7d4a-449f-9e0a-e93f86f23797 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.691772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22849b4b-7d4a-449f-9e0a-e93f86f23797 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.692022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50911399-3727-49f7-bea3-41e1d2430615 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-22849b4b-7d4a-449f-9e0a-e93f86f23797 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:31.710669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:31.711620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:31.713010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:31.713010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:31.713010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:31.713010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:31.716850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 340/677] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:31.718266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f444567-e669-46db-83e8-9763750bca96 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.718563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f444567-e669-46db-83e8-9763750bca96 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.718842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f444567-e669-46db-83e8-9763750bca96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.729065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16aea9-e070-40e8-a5e1-8407ec7b1060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.729727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16aea9-e070-40e8-a5e1-8407ec7b1060 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.730005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16aea9-e070-40e8-a5e1-8407ec7b1060 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.730562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16aea9-e070-40e8-a5e1-8407ec7b1060 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.731228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16aea9-e070-40e8-a5e1-8407ec7b1060 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:31.731535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16aea9-e070-40e8-a5e1-8407ec7b1060 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.733004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16aea9-e070-40e8-a5e1-8407ec7b1060 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.735761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0f444567-e669-46db-83e8-9763750bca96 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:31.736966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0f444567-e669-46db-83e8-9763750bca96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:31.751912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 338/678] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:31.751912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16aea9-e070-40e8-a5e1-8407ec7b1060 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:31.818813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 341/679] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:31.818813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f444567-e669-46db-83e8-9763750bca96 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:31.850107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:31.865983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16aea9-e070-40e8-a5e1-8407ec7b1060 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.866481 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:31.901137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba95d9-a250-44ed-8459-56faa3bc5426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.902272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba95d9-a250-44ed-8459-56faa3bc5426 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.902530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba95d9-a250-44ed-8459-56faa3bc5426 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.902807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba95d9-a250-44ed-8459-56faa3bc5426 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.910588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba95d9-a250-44ed-8459-56faa3bc5426 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.912750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba95d9-a250-44ed-8459-56faa3bc5426 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.926708 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f444567-e669-46db-83e8-9763750bca96 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-deba95d9-a250-44ed-8459-56faa3bc5426 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:31.928197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:31.929185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 339/680] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:31.935173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba95d9-a250-44ed-8459-56faa3bc5426 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:31.966861 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c803d8c-cdc6-4077-8028-6a62542447bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:31.967820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c803d8c-cdc6-4077-8028-6a62542447bc None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:31.968312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c803d8c-cdc6-4077-8028-6a62542447bc None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:31.968789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c803d8c-cdc6-4077-8028-6a62542447bc None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:31.969693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c803d8c-cdc6-4077-8028-6a62542447bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:31.970193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c803d8c-cdc6-4077-8028-6a62542447bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:31.971579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c803d8c-cdc6-4077-8028-6a62542447bc None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:31.988190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 342/681] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:31.988190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c803d8c-cdc6-4077-8028-6a62542447bc None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:32.044773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba95d9-a250-44ed-8459-56faa3bc5426 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:32.084024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54478f8-2b87-42a8-8bf5-bcdd4d360267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:32.084732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54478f8-2b87-42a8-8bf5-bcdd4d360267 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:32.084974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54478f8-2b87-42a8-8bf5-bcdd4d360267 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:32.085249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54478f8-2b87-42a8-8bf5-bcdd4d360267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:32.086078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54478f8-2b87-42a8-8bf5-bcdd4d360267 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=3a06a84967694e68a3a77bf29f16ee3b) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:32.086390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54478f8-2b87-42a8-8bf5-bcdd4d360267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:32.087813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54478f8-2b87-42a8-8bf5-bcdd4d360267 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:32.090160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:32.093956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c803d8c-cdc6-4077-8028-6a62542447bc None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:32.094403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 340/682] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/role_assignments?user.id=3a06a84967694e68a3a77bf29f16ee3b&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:32.095155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54478f8-2b87-42a8-8bf5-bcdd4d360267 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:32.108555 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:32.152210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773d90c-1e75-4a1a-8059-37f92613ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:32.153133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773d90c-1e75-4a1a-8059-37f92613ceee None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:32.153424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773d90c-1e75-4a1a-8059-37f92613ceee None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:32.153702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773d90c-1e75-4a1a-8059-37f92613ceee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:32.167274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773d90c-1e75-4a1a-8059-37f92613ceee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:32.168808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773d90c-1e75-4a1a-8059-37f92613ceee None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c773d90c-1e75-4a1a-8059-37f92613ceee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:32.188254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:32.189267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:32.190176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:32.190176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:32.190176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:32.190176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:32.190176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 343/683] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:32.190890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773d90c-1e75-4a1a-8059-37f92613ceee None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:32.238269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54478f8-2b87-42a8-8bf5-bcdd4d360267 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:32.295363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e6be4-921b-40b9-bfb9-e87a11731120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:32.296045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e6be4-921b-40b9-bfb9-e87a11731120 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:32.296355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e6be4-921b-40b9-bfb9-e87a11731120 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:32.296683 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e6be4-921b-40b9-bfb9-e87a11731120 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:32.297532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e6be4-921b-40b9-bfb9-e87a11731120 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:32.297849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e6be4-921b-40b9-bfb9-e87a11731120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:32.299613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e6be4-921b-40b9-bfb9-e87a11731120 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:32.312981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773d90c-1e75-4a1a-8059-37f92613ceee None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:32.328607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 341/684] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 07:16:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:32.329745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e6be4-921b-40b9-bfb9-e87a11731120 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:32.356181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e6ad0-093d-46e1-bfd6-67c862719a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:32.357651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e6ad0-093d-46e1-bfd6-67c862719a6e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:32.357761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e6ad0-093d-46e1-bfd6-67c862719a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:32.357997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432e6ad0-093d-46e1-bfd6-67c862719a6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:32.366427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e6ad0-093d-46e1-bfd6-67c862719a6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:32.367810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432e6ad0-093d-46e1-bfd6-67c862719a6e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-432e6ad0-093d-46e1-bfd6-67c862719a6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:32.383843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:32.384834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:32.386020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:32.386020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:32.386020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:32.386020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:32.386020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:32.386020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:32.386020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:32.386020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:32.386020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 344/685] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:32.386642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e6ad0-093d-46e1-bfd6-67c862719a6e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:32.402890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:32.415958 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:32.473355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e6be4-921b-40b9-bfb9-e87a11731120 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:32.496729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432e6ad0-093d-46e1-bfd6-67c862719a6e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:32.518874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c5f7a-8789-44d9-9bb4-40b7ea7a0aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:32.519550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c5f7a-8789-44d9-9bb4-40b7ea7a0aaa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:32.519836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c5f7a-8789-44d9-9bb4-40b7ea7a0aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:32.520111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c5f7a-8789-44d9-9bb4-40b7ea7a0aaa None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:32.521566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c5f7a-8789-44d9-9bb4-40b7ea7a0aaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:32.521891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c5f7a-8789-44d9-9bb4-40b7ea7a0aaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:32.523545 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c5f7a-8789-44d9-9bb4-40b7ea7a0aaa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:32.536771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0bc43-790c-4353-8322-5972983d22b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:32.537835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0bc43-790c-4353-8322-5972983d22b0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:32.542318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 342/686] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:32.542318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c5f7a-8789-44d9-9bb4-40b7ea7a0aaa None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:32.542468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0bc43-790c-4353-8322-5972983d22b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:32.542468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0bc43-790c-4353-8322-5972983d22b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:32.636962 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0bc43-790c-4353-8322-5972983d22b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:32.638880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0bc43-790c-4353-8322-5972983d22b0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:32.659043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:32.663864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c5f7a-8789-44d9-9bb4-40b7ea7a0aaa None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:32.692666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:32.703438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e3f4c-f8ec-4c30-9859-f3f2c29b6b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:32.704151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e3f4c-f8ec-4c30-9859-f3f2c29b6b8f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:32.704440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e3f4c-f8ec-4c30-9859-f3f2c29b6b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:32.704810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e3f4c-f8ec-4c30-9859-f3f2c29b6b8f None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:32.705550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e3f4c-f8ec-4c30-9859-f3f2c29b6b8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:32.705860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e3f4c-f8ec-4c30-9859-f3f2c29b6b8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:32.707695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e3f4c-f8ec-4c30-9859-f3f2c29b6b8f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:32.722788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 343/687] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:32.723810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e3f4c-f8ec-4c30-9859-f3f2c29b6b8f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:32.767424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 345/688] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:32.768518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0bc43-790c-4353-8322-5972983d22b0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:32.841904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e3f4c-f8ec-4c30-9859-f3f2c29b6b8f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:32.871313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0bc43-790c-4353-8322-5972983d22b0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:32.879907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456030-fce4-4fc7-83c6-5d9c24b5e2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:32.881078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456030-fce4-4fc7-83c6-5d9c24b5e2d3 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:32.881205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456030-fce4-4fc7-83c6-5d9c24b5e2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:32.881517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456030-fce4-4fc7-83c6-5d9c24b5e2d3 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:32.882295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e456030-fce4-4fc7-83c6-5d9c24b5e2d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:32.884075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e456030-fce4-4fc7-83c6-5d9c24b5e2d3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:32.885720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:32.907503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6242e-c80d-4abd-95f8-1ae9d9b4ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:32.908431 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6242e-c80d-4abd-95f8-1ae9d9b4ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:32.908891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6242e-c80d-4abd-95f8-1ae9d9b4ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:32.909311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c6242e-c80d-4abd-95f8-1ae9d9b4ffb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:32.910351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6242e-c80d-4abd-95f8-1ae9d9b4ffb0 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=a5f94913ac8a463db617fbe30df395b1) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:32.910809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6242e-c80d-4abd-95f8-1ae9d9b4ffb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:32.913120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c6242e-c80d-4abd-95f8-1ae9d9b4ffb0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:32.919648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 346/689] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:32 2022] GET /identity/v3/role_assignments?user.id=a5f94913ac8a463db617fbe30df395b1&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:32.920839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6242e-c80d-4abd-95f8-1ae9d9b4ffb0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:32.998569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 344/690] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:16:32 2022] POST /identity/v3/users => generated 254 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:33.053059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c6242e-c80d-4abd-95f8-1ae9d9b4ffb0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:33.094240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0dead-7d69-4c1c-8d4f-5ba318614a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:33.095462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0dead-7d69-4c1c-8d4f-5ba318614a4e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:33.095947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0dead-7d69-4c1c-8d4f-5ba318614a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:33.096422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0dead-7d69-4c1c-8d4f-5ba318614a4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:33.110930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0dead-7d69-4c1c-8d4f-5ba318614a4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:33.112853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0dead-7d69-4c1c-8d4f-5ba318614a4e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-59d0dead-7d69-4c1c-8d4f-5ba318614a4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:33.132285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:33.133259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:33.134162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:33.134162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:33.134162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:33.134162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:33.136549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 347/691] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:33.141881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456030-fce4-4fc7-83c6-5d9c24b5e2d3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:33.198852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:33.268378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456030-fce4-4fc7-83c6-5d9c24b5e2d3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:33.306636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06367fc-a9c7-4754-a422-c3988d9a9461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:33.307712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06367fc-a9c7-4754-a422-c3988d9a9461 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:33.308214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06367fc-a9c7-4754-a422-c3988d9a9461 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:33.308873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06367fc-a9c7-4754-a422-c3988d9a9461 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:33.309831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06367fc-a9c7-4754-a422-c3988d9a9461 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:33.310337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06367fc-a9c7-4754-a422-c3988d9a9461 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:33.311913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06367fc-a9c7-4754-a422-c3988d9a9461 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:33.328891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 345/692] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:33.332254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0dead-7d69-4c1c-8d4f-5ba318614a4e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:33.366881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:33.453984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0dead-7d69-4c1c-8d4f-5ba318614a4e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:33.489357 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e67b-3757-4d71-8559-97ebe38d782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:33.490477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e67b-3757-4d71-8559-97ebe38d782a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:33.490767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e67b-3757-4d71-8559-97ebe38d782a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:33.491040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc8e67b-3757-4d71-8559-97ebe38d782a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:33.500589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e67b-3757-4d71-8559-97ebe38d782a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:33.502074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc8e67b-3757-4d71-8559-97ebe38d782a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-acc8e67b-3757-4d71-8559-97ebe38d782a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:33.518814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:33.519926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:33.521693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:33.521693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:33.521693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:33.521693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:33.521693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:33.521693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:33.521693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:33.521693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:33.521693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 348/693] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:33.526067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06367fc-a9c7-4754-a422-c3988d9a9461 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:33.665832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06367fc-a9c7-4754-a422-c3988d9a9461 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:33.667408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:33.720235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ffeb9-8672-4a41-9b9e-c2b9002d47f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:33.720915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ffeb9-8672-4a41-9b9e-c2b9002d47f6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:33.721254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ffeb9-8672-4a41-9b9e-c2b9002d47f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:33.721540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ffeb9-8672-4a41-9b9e-c2b9002d47f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:33.722353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ffeb9-8672-4a41-9b9e-c2b9002d47f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:33.723052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ffeb9-8672-4a41-9b9e-c2b9002d47f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:33.725411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92ffeb9-8672-4a41-9b9e-c2b9002d47f6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:33.739361 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 346/694] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:33.745875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e67b-3757-4d71-8559-97ebe38d782a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:33.817610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afba5f-218d-4e43-9501-22fcbdccb7af None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:33.818429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afba5f-218d-4e43-9501-22fcbdccb7af None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:33.818840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afba5f-218d-4e43-9501-22fcbdccb7af None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:33.820798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 347/695] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:33.825865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31e1f4-62dc-42d7-8bd6-5faba1c3d091 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:33.826159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31e1f4-62dc-42d7-8bd6-5faba1c3d091 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:33.826442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31e1f4-62dc-42d7-8bd6-5faba1c3d091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:33.853359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ae31e1f4-62dc-42d7-8bd6-5faba1c3d091 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:33.854576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ae31e1f4-62dc-42d7-8bd6-5faba1c3d091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:33.908457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:33.925646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 348/696] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:16:33.942845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc8e67b-3757-4d71-8559-97ebe38d782a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:33.948533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31e1f4-62dc-42d7-8bd6-5faba1c3d091 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:34.000422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c9152-bd9a-430b-996b-52dc8b37084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:34.001030 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c9152-bd9a-430b-996b-52dc8b37084c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:34.001309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c9152-bd9a-430b-996b-52dc8b37084c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:34.001580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8c9152-bd9a-430b-996b-52dc8b37084c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:34.002408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c9152-bd9a-430b-996b-52dc8b37084c None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=b54767b9f07341c3aa2ba9a120a62ed0) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:34.002714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c9152-bd9a-430b-996b-52dc8b37084c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:34.006462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8c9152-bd9a-430b-996b-52dc8b37084c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:34.022777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 349/697] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:33 2022] GET /identity/v3/role_assignments?user.id=b54767b9f07341c3aa2ba9a120a62ed0&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:34.104649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:34.114454 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31e1f4-62dc-42d7-8bd6-5faba1c3d091 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:34.166858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15135ef-6668-48c8-a2b4-f956b7a62f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:34.167690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15135ef-6668-48c8-a2b4-f956b7a62f08 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:34.167967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15135ef-6668-48c8-a2b4-f956b7a62f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:34.168237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15135ef-6668-48c8-a2b4-f956b7a62f08 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:34.168937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15135ef-6668-48c8-a2b4-f956b7a62f08 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:34.170331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15135ef-6668-48c8-a2b4-f956b7a62f08 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b15135ef-6668-48c8-a2b4-f956b7a62f08 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:34.191843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:34.193103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:34.194479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 349/698] 10.222.0.24 () {56 vars in 1129 bytes} [Wed May 25 07:16:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:34.201612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c9152-bd9a-430b-996b-52dc8b37084c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:34.391785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8c9152-bd9a-430b-996b-52dc8b37084c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:34.436784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c0b6c2-4f9b-46d0-aa2f-abed3aac86c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:34.437454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b6c2-4f9b-46d0-aa2f-abed3aac86c1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:34.437732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b6c2-4f9b-46d0-aa2f-abed3aac86c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:34.438005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c0b6c2-4f9b-46d0-aa2f-abed3aac86c1 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:34.438714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0b6c2-4f9b-46d0-aa2f-abed3aac86c1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:34.439014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0b6c2-4f9b-46d0-aa2f-abed3aac86c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:34.440380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c0b6c2-4f9b-46d0-aa2f-abed3aac86c1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:34.446615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 350/699] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 07:16:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:34.452337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15135ef-6668-48c8-a2b4-f956b7a62f08 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:34.599452 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15135ef-6668-48c8-a2b4-f956b7a62f08 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:34.654266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bca45c-0b6b-4dcb-8e43-6ab12fd4baa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:34.654859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca45c-0b6b-4dcb-8e43-6ab12fd4baa8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:34.655138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca45c-0b6b-4dcb-8e43-6ab12fd4baa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:34.655407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bca45c-0b6b-4dcb-8e43-6ab12fd4baa8 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:34.656111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bca45c-0b6b-4dcb-8e43-6ab12fd4baa8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:34.656415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bca45c-0b6b-4dcb-8e43-6ab12fd4baa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:34.657798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bca45c-0b6b-4dcb-8e43-6ab12fd4baa8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:34.671630 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 350/700] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 07:16:34 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:34.763693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c610b73-0754-4960-b3d1-8c2b3c35aa3c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:34.764054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c610b73-0754-4960-b3d1-8c2b3c35aa3c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:34.764218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c610b73-0754-4960-b3d1-8c2b3c35aa3c None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:34.765934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 351/701] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:34.771863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fab9f-96fb-4e7d-82ca-113eca95b96e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:34.772168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fab9f-96fb-4e7d-82ca-113eca95b96e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:34.772408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82fab9f-96fb-4e7d-82ca-113eca95b96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:34.797150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c82fab9f-96fb-4e7d-82ca-113eca95b96e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:34.798441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c82fab9f-96fb-4e7d-82ca-113eca95b96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:34.824879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:34.898243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 351/702] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:34.923211 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c610b73-0754-4960-b3d1-8c2b3c35aa3c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:34.945559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:35.069304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c610b73-0754-4960-b3d1-8c2b3c35aa3c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:35.116117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9f90d-4f41-4abd-a0f7-f1df17782d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:35.116941 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9f90d-4f41-4abd-a0f7-f1df17782d96 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:35.117221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9f90d-4f41-4abd-a0f7-f1df17782d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:35.117491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9f90d-4f41-4abd-a0f7-f1df17782d96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:35.137373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9f90d-4f41-4abd-a0f7-f1df17782d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6ba9f90d-4f41-4abd-a0f7-f1df17782d96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:35.145023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:35.147437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:35.149488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 352/703] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:35.162228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fab9f-96fb-4e7d-82ca-113eca95b96e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:35.297514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82fab9f-96fb-4e7d-82ca-113eca95b96e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:35.343774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffa99f-5b7f-42fd-9981-1621434c2568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:35.344454 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffa99f-5b7f-42fd-9981-1621434c2568 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:35.344751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffa99f-5b7f-42fd-9981-1621434c2568 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:35.345027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ffa99f-5b7f-42fd-9981-1621434c2568 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:35.345778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffa99f-5b7f-42fd-9981-1621434c2568 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:35.346079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffa99f-5b7f-42fd-9981-1621434c2568 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:35.347550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ffa99f-5b7f-42fd-9981-1621434c2568 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:35.360630 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 352/704] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:35.366174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9f90d-4f41-4abd-a0f7-f1df17782d96 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:35.466906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:35.496314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9f90d-4f41-4abd-a0f7-f1df17782d96 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:35.544731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f852a-d4de-41e2-a7a2-945e192d3986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:35.545891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f852a-d4de-41e2-a7a2-945e192d3986 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:35.546403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f852a-d4de-41e2-a7a2-945e192d3986 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:35.546880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f852a-d4de-41e2-a7a2-945e192d3986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:35.560060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f852a-d4de-41e2-a7a2-945e192d3986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:35.561826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f852a-d4de-41e2-a7a2-945e192d3986 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-fa8f852a-d4de-41e2-a7a2-945e192d3986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:35.579461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:35.580404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:35.581368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:35.581368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:35.581368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:35.581368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:35.584159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 353/705] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:35.593042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffa99f-5b7f-42fd-9981-1621434c2568 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:35.623181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:35.671658 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b8588-3eac-4f03-bbf7-4867dea80822 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:35.672350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b8588-3eac-4f03-bbf7-4867dea80822 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:35.672879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b8588-3eac-4f03-bbf7-4867dea80822 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:35.675523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 354/706] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:35.682028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5d6db-75c4-4ca7-8c49-66222c24baf4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:35.682633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5d6db-75c4-4ca7-8c49-66222c24baf4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:35.683112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a5d6db-75c4-4ca7-8c49-66222c24baf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:35.720878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-32a5d6db-75c4-4ca7-8c49-66222c24baf4 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:35.722459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-32a5d6db-75c4-4ca7-8c49-66222c24baf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:35.735358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ffa99f-5b7f-42fd-9981-1621434c2568 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:35.773159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09596ed-d9c7-4a99-8fc5-f179602d5663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:35.773820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09596ed-d9c7-4a99-8fc5-f179602d5663 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:35.774101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09596ed-d9c7-4a99-8fc5-f179602d5663 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:35.774371 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09596ed-d9c7-4a99-8fc5-f179602d5663 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:35.775092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09596ed-d9c7-4a99-8fc5-f179602d5663 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:35.775396 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09596ed-d9c7-4a99-8fc5-f179602d5663 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:35.776794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09596ed-d9c7-4a99-8fc5-f179602d5663 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:35.790374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 353/707] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:35.796358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09596ed-d9c7-4a99-8fc5-f179602d5663 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:35.885334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 355/708] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:35.919350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5d6db-75c4-4ca7-8c49-66222c24baf4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:35.928899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:35.954889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09596ed-d9c7-4a99-8fc5-f179602d5663 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:35.995343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d208152-166e-4b88-aea8-e95351499e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:35.997550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d208152-166e-4b88-aea8-e95351499e30 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:35.997839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d208152-166e-4b88-aea8-e95351499e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:35.998115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d208152-166e-4b88-aea8-e95351499e30 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.017968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d208152-166e-4b88-aea8-e95351499e30 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:36.022969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d208152-166e-4b88-aea8-e95351499e30 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-4d208152-166e-4b88-aea8-e95351499e30 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:36.056405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:36.057503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:36.058488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:36.061113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:36.064281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 354/709] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 07:16:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:36.065484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d208152-166e-4b88-aea8-e95351499e30 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:36.125531 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a5d6db-75c4-4ca7-8c49-66222c24baf4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:36.188521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d208152-166e-4b88-aea8-e95351499e30 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:36.215833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d17d45-03a6-48cd-adfa-7e743768a384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:36.216926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d17d45-03a6-48cd-adfa-7e743768a384 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:36.217206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d17d45-03a6-48cd-adfa-7e743768a384 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:36.217474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d17d45-03a6-48cd-adfa-7e743768a384 None admin] PATH_INFO: `/v3/services/network` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.218240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d17d45-03a6-48cd-adfa-7e743768a384 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:36.219945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d17d45-03a6-48cd-adfa-7e743768a384 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:36.228851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:36.231095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2dfdc-5b67-4ce7-89ea-f4137acd5d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:36.232650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2dfdc-5b67-4ce7-89ea-f4137acd5d2c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:36.232986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2dfdc-5b67-4ce7-89ea-f4137acd5d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:36.233265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2dfdc-5b67-4ce7-89ea-f4137acd5d2c None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.236834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2dfdc-5b67-4ce7-89ea-f4137acd5d2c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:36.237147 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2dfdc-5b67-4ce7-89ea-f4137acd5d2c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:36.238590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2dfdc-5b67-4ce7-89ea-f4137acd5d2c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-87d17d45-03a6-48cd-adfa-7e743768a384 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:36.257295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:36.259632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:16:36.261779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:36.265039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 356/710] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:35 2022] GET /identity/v3/services/network => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:36.266320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d17d45-03a6-48cd-adfa-7e743768a384 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:36.294213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 355/711] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 07:16:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:36.295710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0950-267a-444f-ac4a-cc2f20a315b1 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:36.295997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0950-267a-444f-ac4a-cc2f20a315b1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:36.296275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f0950-267a-444f-ac4a-cc2f20a315b1 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.302023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 356/712] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:36.304666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f0950-267a-444f-ac4a-cc2f20a315b1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:36.396361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d17d45-03a6-48cd-adfa-7e743768a384 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:36.415612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f0950-267a-444f-ac4a-cc2f20a315b1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:36.419773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:36.432245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ead7d-e0d5-43ee-b66e-d136233f8c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:36.433124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ead7d-e0d5-43ee-b66e-d136233f8c64 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:36.433477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ead7d-e0d5-43ee-b66e-d136233f8c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:36.433820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ead7d-e0d5-43ee-b66e-d136233f8c64 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.434598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ead7d-e0d5-43ee-b66e-d136233f8c64 None admin] RBAC: Adding query filter params (name=network) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:36.434971 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ead7d-e0d5-43ee-b66e-d136233f8c64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:36.436637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778ead7d-e0d5-43ee-b66e-d136233f8c64 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:36.441538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 357/713] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:16:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:36.442967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c3ebc-75ea-4cc1-88d2-e311f887f2f0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:36.443353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c3ebc-75ea-4cc1-88d2-e311f887f2f0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:36.443698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c3ebc-75ea-4cc1-88d2-e311f887f2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.462653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0f9c3ebc-75ea-4cc1-88d2-e311f887f2f0 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:36.463927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0f9c3ebc-75ea-4cc1-88d2-e311f887f2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:36.467122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54486bbe-1022-477c-af0c-3e748ffc1a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:36.468592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54486bbe-1022-477c-af0c-3e748ffc1a18 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:36.468876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54486bbe-1022-477c-af0c-3e748ffc1a18 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:36.469149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54486bbe-1022-477c-af0c-3e748ffc1a18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.535131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 358/714] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:36.535985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c3ebc-75ea-4cc1-88d2-e311f887f2f0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:36.557671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:36.575692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54486bbe-1022-477c-af0c-3e748ffc1a18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:36.577254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54486bbe-1022-477c-af0c-3e748ffc1a18 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:36.693942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c3ebc-75ea-4cc1-88d2-e311f887f2f0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:36.694261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 357/715] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:36.699636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54486bbe-1022-477c-af0c-3e748ffc1a18 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:36.715452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:36.741330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19941357-5496-403e-9d21-9b32ec5f5b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:36.742544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19941357-5496-403e-9d21-9b32ec5f5b2e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:36.743027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19941357-5496-403e-9d21-9b32ec5f5b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:36.743496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19941357-5496-403e-9d21-9b32ec5f5b2e None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.744430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19941357-5496-403e-9d21-9b32ec5f5b2e None admin] RBAC: Adding query filter params (type=network) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:36.745002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19941357-5496-403e-9d21-9b32ec5f5b2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:36.747762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19941357-5496-403e-9d21-9b32ec5f5b2e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:36.756783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 359/716] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:16:36 2022] GET /identity/v3/services?type=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:36.758093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19941357-5496-403e-9d21-9b32ec5f5b2e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:36.814254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:36.827393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54486bbe-1022-477c-af0c-3e748ffc1a18 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:36.869463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4ce3b6-f36b-4d53-ac7a-a62f218faceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:36.870649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ce3b6-f36b-4d53-ac7a-a62f218faceb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:36.871570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ce3b6-f36b-4d53-ac7a-a62f218faceb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:36.872060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4ce3b6-f36b-4d53-ac7a-a62f218faceb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.901936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4ce3b6-f36b-4d53-ac7a-a62f218faceb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ef4ce3b6-f36b-4d53-ac7a-a62f218faceb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:36.913950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:36.914960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:36.915821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:36.933141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 358/717] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:36.935008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a98c-3d4d-4b57-af7e-683595b08d07 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:36.935294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a98c-3d4d-4b57-af7e-683595b08d07 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:36.935572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d2a98c-3d4d-4b57-af7e-683595b08d07 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:36.937441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 359/718] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:36.938332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a98c-3d4d-4b57-af7e-683595b08d07 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:36.971554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19941357-5496-403e-9d21-9b32ec5f5b2e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:37.016282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b829b2-a406-4f25-b65b-bf78022d041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:37.017112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b829b2-a406-4f25-b65b-bf78022d041e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.017839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b829b2-a406-4f25-b65b-bf78022d041e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.018122 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b829b2-a406-4f25-b65b-bf78022d041e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.030435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b829b2-a406-4f25-b65b-bf78022d041e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:37.032235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b829b2-a406-4f25-b65b-bf78022d041e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-80b829b2-a406-4f25-b65b-bf78022d041e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:37.050665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:37.051592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:37.059812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:37.059812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:37.059812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:37.059812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:37.059812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 360/719] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:37.059812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3d77f-a4f6-44fa-bde7-e0295cd427e8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.059812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3d77f-a4f6-44fa-bde7-e0295cd427e8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.059812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3d77f-a4f6-44fa-bde7-e0295cd427e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.079271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d2a98c-3d4d-4b57-af7e-683595b08d07 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:37.084352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-41f3d77f-a4f6-44fa-bde7-e0295cd427e8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:37.085632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-41f3d77f-a4f6-44fa-bde7-e0295cd427e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:37.124659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:37.124858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e6645-6357-4b07-868f-541ffe746266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:37.125808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e6645-6357-4b07-868f-541ffe746266 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.126195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e6645-6357-4b07-868f-541ffe746266 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.126867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e6645-6357-4b07-868f-541ffe746266 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.128013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e6645-6357-4b07-868f-541ffe746266 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:37.128422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e6645-6357-4b07-868f-541ffe746266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:37.130447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e6645-6357-4b07-868f-541ffe746266 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:37.140797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 360/720] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:37.142077 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e6645-6357-4b07-868f-541ffe746266 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:37.177868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 361/721] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:37.179384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3d77f-a4f6-44fa-bde7-e0295cd427e8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:37.180863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:37.310018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3d77f-a4f6-44fa-bde7-e0295cd427e8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:37.311675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e6645-6357-4b07-868f-541ffe746266 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:37.346529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa570bbb-5774-44f3-8d05-8b3a6a9eee69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:37.347594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570bbb-5774-44f3-8d05-8b3a6a9eee69 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.348019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570bbb-5774-44f3-8d05-8b3a6a9eee69 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.348436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa570bbb-5774-44f3-8d05-8b3a6a9eee69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.348905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ea7f43-e5d2-4efd-8866-265b4ebaece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:37.349619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7f43-e5d2-4efd-8866-265b4ebaece0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.349906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7f43-e5d2-4efd-8866-265b4ebaece0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.350182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ea7f43-e5d2-4efd-8866-265b4ebaece0 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.350905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea7f43-e5d2-4efd-8866-265b4ebaece0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:37.351210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea7f43-e5d2-4efd-8866-265b4ebaece0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:37.352604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ea7f43-e5d2-4efd-8866-265b4ebaece0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:37.360410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa570bbb-5774-44f3-8d05-8b3a6a9eee69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:37.362245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa570bbb-5774-44f3-8d05-8b3a6a9eee69 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-fa570bbb-5774-44f3-8d05-8b3a6a9eee69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:37.382871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:37.383871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:37.384866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:37.384866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:37.384866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:37.384866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:37.390843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 362/722] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:37.390843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa570bbb-5774-44f3-8d05-8b3a6a9eee69 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:37.408979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:37.490513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 361/723] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:37.490513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d337a46-16c3-4ead-bfc7-ccfd08fc0c80 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.490513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d337a46-16c3-4ead-bfc7-ccfd08fc0c80 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.490513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d337a46-16c3-4ead-bfc7-ccfd08fc0c80 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.490513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 362/724] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:37.490513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d337a46-16c3-4ead-bfc7-ccfd08fc0c80 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:37.510492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa570bbb-5774-44f3-8d05-8b3a6a9eee69 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:37.546200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c83f58-3b84-4e86-aace-d967b506156f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:37.547113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c83f58-3b84-4e86-aace-d967b506156f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.547461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c83f58-3b84-4e86-aace-d967b506156f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.547830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c83f58-3b84-4e86-aace-d967b506156f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.559579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c83f58-3b84-4e86-aace-d967b506156f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:37.563218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f8c83f58-3b84-4e86-aace-d967b506156f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:37.568440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:37.574218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 363/725] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:37.575090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c83f58-3b84-4e86-aace-d967b506156f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:37.604755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d337a46-16c3-4ead-bfc7-ccfd08fc0c80 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:37.644659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5164ac7-ff9e-473f-8c0f-d659f173cb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:37.645566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5164ac7-ff9e-473f-8c0f-d659f173cb5c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.646011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5164ac7-ff9e-473f-8c0f-d659f173cb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.646399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5164ac7-ff9e-473f-8c0f-d659f173cb5c None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.647130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5164ac7-ff9e-473f-8c0f-d659f173cb5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:37.647436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5164ac7-ff9e-473f-8c0f-d659f173cb5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:37.648831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5164ac7-ff9e-473f-8c0f-d659f173cb5c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:37.660774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 363/726] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:37.662410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c0df4-84db-42a6-b236-0854beb4a3ef None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.662728 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c0df4-84db-42a6-b236-0854beb4a3ef None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.663009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c0df4-84db-42a6-b236-0854beb4a3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.673833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:37.681503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e66c0df4-84db-42a6-b236-0854beb4a3ef None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:37.682705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e66c0df4-84db-42a6-b236-0854beb4a3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:37.700029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c83f58-3b84-4e86-aace-d967b506156f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:37.737410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c062ff8-2e6c-4833-add8-3e6bd09f0d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:37.738206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c062ff8-2e6c-4833-add8-3e6bd09f0d08 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.738486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c062ff8-2e6c-4833-add8-3e6bd09f0d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.738760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c062ff8-2e6c-4833-add8-3e6bd09f0d08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.746132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c062ff8-2e6c-4833-add8-3e6bd09f0d08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:37.747585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c062ff8-2e6c-4833-add8-3e6bd09f0d08 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:37.753901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 364/727] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:37.761384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c0df4-84db-42a6-b236-0854beb4a3ef None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-5c062ff8-2e6c-4833-add8-3e6bd09f0d08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:37.762862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:37.763764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:37.764686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:37.764686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:37.764686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:37.764686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:37.764686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:37.764686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:37.764686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:37.764686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:37.768910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 364/728] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:37.769737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c062ff8-2e6c-4833-add8-3e6bd09f0d08 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:37.833923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:37.873973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c0df4-84db-42a6-b236-0854beb4a3ef None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:37.878669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c062ff8-2e6c-4833-add8-3e6bd09f0d08 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:37.908361 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e752cd-60c8-49b0-a5fe-eb1b7dadd5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:37.909067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e752cd-60c8-49b0-a5fe-eb1b7dadd5e0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.909338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e752cd-60c8-49b0-a5fe-eb1b7dadd5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.909616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e752cd-60c8-49b0-a5fe-eb1b7dadd5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.910352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e752cd-60c8-49b0-a5fe-eb1b7dadd5e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:37.910645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e752cd-60c8-49b0-a5fe-eb1b7dadd5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:37.912187 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e752cd-60c8-49b0-a5fe-eb1b7dadd5e0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:37.914961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3d3c9-69eb-4da9-b651-95e9a0c305a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:37.915979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3d3c9-69eb-4da9-b651-95e9a0c305a7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:37.916438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3d3c9-69eb-4da9-b651-95e9a0c305a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:37.916943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad3d3c9-69eb-4da9-b651-95e9a0c305a7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:37.919257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:37.921009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 365/729] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:37.921549 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e752cd-60c8-49b0-a5fe-eb1b7dadd5e0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:37.930565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3d3c9-69eb-4da9-b651-95e9a0c305a7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:37.933994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad3d3c9-69eb-4da9-b651-95e9a0c305a7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6ad3d3c9-69eb-4da9-b651-95e9a0c305a7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:37.948825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:37.949837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:37.950828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 365/730] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:16:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:37.951450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3d3c9-69eb-4da9-b651-95e9a0c305a7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:38.035822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e752cd-60c8-49b0-a5fe-eb1b7dadd5e0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:38.061412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:38.065677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad3d3c9-69eb-4da9-b651-95e9a0c305a7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:38.071649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12895d8-34b9-4974-b25d-ac785f035a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:38.072311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12895d8-34b9-4974-b25d-ac785f035a20 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:38.072623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12895d8-34b9-4974-b25d-ac785f035a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:38.072899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12895d8-34b9-4974-b25d-ac785f035a20 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:38.073701 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12895d8-34b9-4974-b25d-ac785f035a20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:38.074003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12895d8-34b9-4974-b25d-ac785f035a20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:38.075445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12895d8-34b9-4974-b25d-ac785f035a20 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:38.092657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 366/731] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:38.092657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12895d8-34b9-4974-b25d-ac785f035a20 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:38.107767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcfd27-4577-46e3-93f6-cd431391efbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:38.108628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcfd27-4577-46e3-93f6-cd431391efbe None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:38.108910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcfd27-4577-46e3-93f6-cd431391efbe None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:38.109300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcfd27-4577-46e3-93f6-cd431391efbe None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:38.110146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcfd27-4577-46e3-93f6-cd431391efbe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:38.111506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bcfd27-4577-46e3-93f6-cd431391efbe None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:38.190101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12895d8-34b9-4974-b25d-ac785f035a20 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:38.211093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 366/732] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:16:37 2022] POST /identity/v3/services => generated 251 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:38.212268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcfd27-4577-46e3-93f6-cd431391efbe None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:38.256099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9763a34-b243-450d-975f-ee036208b243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:38.256979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9763a34-b243-450d-975f-ee036208b243 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:38.257259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9763a34-b243-450d-975f-ee036208b243 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:38.257534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9763a34-b243-450d-975f-ee036208b243 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:38.270200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9763a34-b243-450d-975f-ee036208b243 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:38.272029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9763a34-b243-450d-975f-ee036208b243 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a9763a34-b243-450d-975f-ee036208b243 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:38.293004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:38.294014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:38.294924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:38.294924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:38.294924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:38.294924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:38.299419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:38.299577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 367/733] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:38.301131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9763a34-b243-450d-975f-ee036208b243 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:38.340228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:38.362630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcfd27-4577-46e3-93f6-cd431391efbe None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:38.414271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd7eb3-3a45-4953-9958-076f22a1116a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:38.414967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd7eb3-3a45-4953-9958-076f22a1116a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:38.415252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd7eb3-3a45-4953-9958-076f22a1116a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:38.415535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edd7eb3-3a45-4953-9958-076f22a1116a None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:38.416530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd7eb3-3a45-4953-9958-076f22a1116a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:38.416968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd7eb3-3a45-4953-9958-076f22a1116a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:38.418541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edd7eb3-3a45-4953-9958-076f22a1116a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:38.423352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9763a34-b243-450d-975f-ee036208b243 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:38.438111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 367/734] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 07:16:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:38.438748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd7eb3-3a45-4953-9958-076f22a1116a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:38.466181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f96ae-01d2-4d3c-95d2-80bf75ad8171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:38.467103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f96ae-01d2-4d3c-95d2-80bf75ad8171 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:38.467391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f96ae-01d2-4d3c-95d2-80bf75ad8171 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:38.467711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4f96ae-01d2-4d3c-95d2-80bf75ad8171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:38.469337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f96ae-01d2-4d3c-95d2-80bf75ad8171 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=3a06a84967694e68a3a77bf29f16ee3b) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:38.469337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f96ae-01d2-4d3c-95d2-80bf75ad8171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:38.470261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4f96ae-01d2-4d3c-95d2-80bf75ad8171 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:38.479274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 368/735] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:38 2022] GET /identity/v3/role_assignments?user.id=3a06a84967694e68a3a77bf29f16ee3b&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=7c09d078126441909df0a46212ffea63 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:38.480183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f96ae-01d2-4d3c-95d2-80bf75ad8171 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:38.604801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edd7eb3-3a45-4953-9958-076f22a1116a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:38.632946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:38.665104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:38.674520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4f96ae-01d2-4d3c-95d2-80bf75ad8171 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:38.679584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb3df-9cba-4270-9653-b62b6af7faa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:38.680276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb3df-9cba-4270-9653-b62b6af7faa5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:38.680641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb3df-9cba-4270-9653-b62b6af7faa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:38.680918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bb3df-9cba-4270-9653-b62b6af7faa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:38.681671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb3df-9cba-4270-9653-b62b6af7faa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:38.681981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb3df-9cba-4270-9653-b62b6af7faa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:38.683399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bb3df-9cba-4270-9653-b62b6af7faa5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:38.705727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 368/736] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:38.714065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb3df-9cba-4270-9653-b62b6af7faa5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:38.770587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10e5e5-8b42-4632-b2e3-300da2c97ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:38.771469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10e5e5-8b42-4632-b2e3-300da2c97ab3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:38.771757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10e5e5-8b42-4632-b2e3-300da2c97ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:38.772038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10e5e5-8b42-4632-b2e3-300da2c97ab3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:38.858887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bb3df-9cba-4270-9653-b62b6af7faa5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:38.899560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265fe68-4d66-480d-bcc3-4a2eb0d315b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:38.900723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265fe68-4d66-480d-bcc3-4a2eb0d315b3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:38.901193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265fe68-4d66-480d-bcc3-4a2eb0d315b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:38.901662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265fe68-4d66-480d-bcc3-4a2eb0d315b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:38.912248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265fe68-4d66-480d-bcc3-4a2eb0d315b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:38.914781 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265fe68-4d66-480d-bcc3-4a2eb0d315b3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:38.917813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10e5e5-8b42-4632-b2e3-300da2c97ab3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:38.919308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d10e5e5-8b42-4632-b2e3-300da2c97ab3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2265fe68-4d66-480d-bcc3-4a2eb0d315b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:38.933125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:38.934173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:38.935148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:38.938235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 369/737] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:38.945316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265fe68-4d66-480d-bcc3-4a2eb0d315b3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:38.981695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:39.061413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265fe68-4d66-480d-bcc3-4a2eb0d315b3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:39.132807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204816ef-3724-47ec-b40f-8ff18c7b2e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:39.134024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204816ef-3724-47ec-b40f-8ff18c7b2e17 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:39.134488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204816ef-3724-47ec-b40f-8ff18c7b2e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:39.135175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204816ef-3724-47ec-b40f-8ff18c7b2e17 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:39.136707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204816ef-3724-47ec-b40f-8ff18c7b2e17 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:39.137471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204816ef-3724-47ec-b40f-8ff18c7b2e17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:39.139985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204816ef-3724-47ec-b40f-8ff18c7b2e17 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:39.149667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:39.156715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 369/738] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:38 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:39.158146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c391-1846-412a-b238-0dd5285c4cc2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:39.158470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c391-1846-412a-b238-0dd5285c4cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:39.158750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c36c391-1846-412a-b238-0dd5285c4cc2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:39.164496 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 370/739] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:39.165037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 370/740] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 07:16:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:39.165610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c391-1846-412a-b238-0dd5285c4cc2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:39.171009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f1574-b91d-4546-983e-fa919ae6bccc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:39.171009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f1574-b91d-4546-983e-fa919ae6bccc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:39.171009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f1574-b91d-4546-983e-fa919ae6bccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:39.194597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-597f1574-b91d-4546-983e-fa919ae6bccc None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:39.196722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-597f1574-b91d-4546-983e-fa919ae6bccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:39.279628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c36c391-1846-412a-b238-0dd5285c4cc2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:39.289401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 371/741] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:39 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:16:39.290968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f1574-b91d-4546-983e-fa919ae6bccc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:39.314827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:39.338047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ac19b-3632-4619-b0b8-0cbec34c1e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:39.338885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ac19b-3632-4619-b0b8-0cbec34c1e5e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:39.339161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ac19b-3632-4619-b0b8-0cbec34c1e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:39.339434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ac19b-3632-4619-b0b8-0cbec34c1e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:39.350688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ac19b-3632-4619-b0b8-0cbec34c1e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:39.352135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ac19b-3632-4619-b0b8-0cbec34c1e5e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-007ac19b-3632-4619-b0b8-0cbec34c1e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:39.371532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:39.372503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:39.373456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:39.373456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:39.373456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:39.373456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:39.373456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 371/742] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:39.373456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ac19b-3632-4619-b0b8-0cbec34c1e5e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:39.413325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f1574-b91d-4546-983e-fa919ae6bccc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:39.437949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:39.452832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49796d1-b057-4476-b2e7-d31a7d0082bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:39.453534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49796d1-b057-4476-b2e7-d31a7d0082bd None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:39.453817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49796d1-b057-4476-b2e7-d31a7d0082bd None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:39.454088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49796d1-b057-4476-b2e7-d31a7d0082bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:39.506502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ac19b-3632-4619-b0b8-0cbec34c1e5e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:39.542908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49796d1-b057-4476-b2e7-d31a7d0082bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:39.544817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49796d1-b057-4476-b2e7-d31a7d0082bd None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:39.555896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332cee-2056-450b-8657-f0e5db6bbd3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:39.557283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332cee-2056-450b-8657-f0e5db6bbd3d None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:39.557902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332cee-2056-450b-8657-f0e5db6bbd3d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:39.558479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49332cee-2056-450b-8657-f0e5db6bbd3d None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:39.559390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49332cee-2056-450b-8657-f0e5db6bbd3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:39.561878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49332cee-2056-450b-8657-f0e5db6bbd3d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:39.568736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:39.658181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 372/743] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:39 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:16:39.658181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49796d1-b057-4476-b2e7-d31a7d0082bd None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:39.683178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 372/744] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:16:39 2022] POST /identity/v3/services => generated 240 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:39.689877 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332cee-2056-450b-8657-f0e5db6bbd3d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:39.882936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49796d1-b057-4476-b2e7-d31a7d0082bd None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:39.909411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49332cee-2056-450b-8657-f0e5db6bbd3d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:39.913004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:39.918674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:39.933981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631c962-bb7a-4120-a29f-f8a74e6e27ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:39.934907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631c962-bb7a-4120-a29f-f8a74e6e27ec None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:39.935367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631c962-bb7a-4120-a29f-f8a74e6e27ec None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:39.935847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631c962-bb7a-4120-a29f-f8a74e6e27ec None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:39.936778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631c962-bb7a-4120-a29f-f8a74e6e27ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:39.937262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631c962-bb7a-4120-a29f-f8a74e6e27ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:39.938888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631c962-bb7a-4120-a29f-f8a74e6e27ec None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:39.951151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 373/745] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:39.952263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24162cd-e517-4877-92f5-514ea4fd4f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:39.952871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24162cd-e517-4877-92f5-514ea4fd4f84 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:39.953221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24162cd-e517-4877-92f5-514ea4fd4f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:39.953564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24162cd-e517-4877-92f5-514ea4fd4f84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:39.956957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631c962-bb7a-4120-a29f-f8a74e6e27ec None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:39.967312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24162cd-e517-4877-92f5-514ea4fd4f84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:39.969446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24162cd-e517-4877-92f5-514ea4fd4f84 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f24162cd-e517-4877-92f5-514ea4fd4f84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:39.987404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:39.988605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:39.990232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:39.990232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:39.990232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:39.990232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:39.992792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 373/746] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:39.998631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24162cd-e517-4877-92f5-514ea4fd4f84 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:40.099963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631c962-bb7a-4120-a29f-f8a74e6e27ec None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:40.114164 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24162cd-e517-4877-92f5-514ea4fd4f84 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:40.144773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bda03-4939-4e9b-aac8-0a0f5eefd617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:40.146579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bda03-4939-4e9b-aac8-0a0f5eefd617 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:40.147417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bda03-4939-4e9b-aac8-0a0f5eefd617 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:40.147849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24bda03-4939-4e9b-aac8-0a0f5eefd617 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:40.155428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770d61d-568c-47f8-a760-7830d43f8183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:40.156200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770d61d-568c-47f8-a760-7830d43f8183 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:40.156623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770d61d-568c-47f8-a760-7830d43f8183 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:40.156994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770d61d-568c-47f8-a760-7830d43f8183 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:40.157224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bda03-4939-4e9b-aac8-0a0f5eefd617 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:40.157921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770d61d-568c-47f8-a760-7830d43f8183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:40.158324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770d61d-568c-47f8-a760-7830d43f8183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:40.159138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24bda03-4939-4e9b-aac8-0a0f5eefd617 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:40.160052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2770d61d-568c-47f8-a760-7830d43f8183 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:40.176427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 374/747] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c24bda03-4939-4e9b-aac8-0a0f5eefd617 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:40.179256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:40.180120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:40.181083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:40.181083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:40.181083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:40.181083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:40.181083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:40.181083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:40.181083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:40.181083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:40.183427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 374/748] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:40.183713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770d61d-568c-47f8-a760-7830d43f8183 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:40.188787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bda03-4939-4e9b-aac8-0a0f5eefd617 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:40.204507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:40.278736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:40.292938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770d61d-568c-47f8-a760-7830d43f8183 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:40.345220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f03730-637a-40df-b1a2-2fd5d0b1ddf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:40.346039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f03730-637a-40df-b1a2-2fd5d0b1ddf6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:40.346323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f03730-637a-40df-b1a2-2fd5d0b1ddf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:40.346600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f03730-637a-40df-b1a2-2fd5d0b1ddf6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:40.365556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f03730-637a-40df-b1a2-2fd5d0b1ddf6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:40.367030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f03730-637a-40df-b1a2-2fd5d0b1ddf6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:40.369965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24bda03-4939-4e9b-aac8-0a0f5eefd617 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a3f03730-637a-40df-b1a2-2fd5d0b1ddf6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:40.405440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:40.406430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:40.407314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:40.407314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:40.407314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:40.407314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:40.407314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:40.407314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:40.407314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:40.407314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:40.407314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 375/749] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:40.416129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318667de-fd96-4b6f-bf8a-25dd6a63a5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:40.417128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318667de-fd96-4b6f-bf8a-25dd6a63a5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:40.417449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f03730-637a-40df-b1a2-2fd5d0b1ddf6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:40.418027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318667de-fd96-4b6f-bf8a-25dd6a63a5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:40.418498 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318667de-fd96-4b6f-bf8a-25dd6a63a5f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:40.419486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318667de-fd96-4b6f-bf8a-25dd6a63a5f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:40.419993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318667de-fd96-4b6f-bf8a-25dd6a63a5f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:40.422611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318667de-fd96-4b6f-bf8a-25dd6a63a5f7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:40.437646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 375/750] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:40.460115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318667de-fd96-4b6f-bf8a-25dd6a63a5f7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:40.521100 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:40.546457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f03730-637a-40df-b1a2-2fd5d0b1ddf6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:40.598163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52855c3d-9043-4844-ac5e-b9c6579899b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:40.598933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52855c3d-9043-4844-ac5e-b9c6579899b6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:40.599220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52855c3d-9043-4844-ac5e-b9c6579899b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:40.599500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52855c3d-9043-4844-ac5e-b9c6579899b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:40.600315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52855c3d-9043-4844-ac5e-b9c6579899b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:40.600652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52855c3d-9043-4844-ac5e-b9c6579899b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:40.602097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52855c3d-9043-4844-ac5e-b9c6579899b6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:40.638909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 376/751] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:40.648616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52855c3d-9043-4844-ac5e-b9c6579899b6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:40.668518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:40.668518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318667de-fd96-4b6f-bf8a-25dd6a63a5f7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:40.735081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d72da7c-bb88-432e-b76f-629945a2f5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:40.735661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72da7c-bb88-432e-b76f-629945a2f5cc None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:40.735940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72da7c-bb88-432e-b76f-629945a2f5cc None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:40.736212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d72da7c-bb88-432e-b76f-629945a2f5cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:40.737072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72da7c-bb88-432e-b76f-629945a2f5cc None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=442cda3fdb25400a8cdab1655717b1e5) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:40.737381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72da7c-bb88-432e-b76f-629945a2f5cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:40.738818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d72da7c-bb88-432e-b76f-629945a2f5cc None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:40.755719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 376/752] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:40 2022] GET /identity/v3/role_assignments?user.id=442cda3fdb25400a8cdab1655717b1e5&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:40.757174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d419f-bd6a-40ae-8e40-44a7dc3c3227 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:40.757461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d419f-bd6a-40ae-8e40-44a7dc3c3227 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:40.758536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d419f-bd6a-40ae-8e40-44a7dc3c3227 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:40.761003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 377/753] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:40.778227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7b9e-0130-4eb2-8ee7-6ba7c3f4146c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:40.778543 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7b9e-0130-4eb2-8ee7-6ba7c3f4146c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:40.778779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7b9e-0130-4eb2-8ee7-6ba7c3f4146c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:40.803381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-09db7b9e-0130-4eb2-8ee7-6ba7c3f4146c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:40.804621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-09db7b9e-0130-4eb2-8ee7-6ba7c3f4146c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:40.849183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52855c3d-9043-4844-ac5e-b9c6579899b6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:40.902605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 378/754] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:40.926000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db7b9e-0130-4eb2-8ee7-6ba7c3f4146c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:40.932067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0529c9-8052-46b5-bd24-590c5bfc2777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:40.933542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0529c9-8052-46b5-bd24-590c5bfc2777 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:40.934294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0529c9-8052-46b5-bd24-590c5bfc2777 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:40.934793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0529c9-8052-46b5-bd24-590c5bfc2777 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:40.935882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0529c9-8052-46b5-bd24-590c5bfc2777 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=b54767b9f07341c3aa2ba9a120a62ed0) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:40.936406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0529c9-8052-46b5-bd24-590c5bfc2777 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:40.939278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0529c9-8052-46b5-bd24-590c5bfc2777 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:40.947592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 377/755] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:40 2022] GET /identity/v3/role_assignments?user.id=b54767b9f07341c3aa2ba9a120a62ed0&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=7c09d078126441909df0a46212ffea63 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:40.948037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:41.051993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:41.060718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db7b9e-0130-4eb2-8ee7-6ba7c3f4146c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:41.061018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8808-fd80-48cc-986a-34e2f665549e None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:41.068650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8808-fd80-48cc-986a-34e2f665549e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:41.068650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8808-fd80-48cc-986a-34e2f665549e None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:41.068650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 378/756] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:16:41.070927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa82114-947c-42a3-a286-1024a8c44921 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:41.071215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa82114-947c-42a3-a286-1024a8c44921 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:41.071494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa82114-947c-42a3-a286-1024a8c44921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:41.097000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4aa82114-947c-42a3-a286-1024a8c44921 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:41.098221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4aa82114-947c-42a3-a286-1024a8c44921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:41.122624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a90176-3f95-44c7-87da-d5b05c38ea6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:41.123458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a90176-3f95-44c7-87da-d5b05c38ea6c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:41.123736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a90176-3f95-44c7-87da-d5b05c38ea6c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:41.124007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a90176-3f95-44c7-87da-d5b05c38ea6c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:41.124697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a90176-3f95-44c7-87da-d5b05c38ea6c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:41.126114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a90176-3f95-44c7-87da-d5b05c38ea6c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-45a90176-3f95-44c7-87da-d5b05c38ea6c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:41.149915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:41.150933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:16:41.151768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:41.156998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 379/757] 10.222.0.24 () {56 vars in 1129 bytes} [Wed May 25 07:16:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:41.161750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a90176-3f95-44c7-87da-d5b05c38ea6c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:41.243160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 379/758] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:41.282094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa82114-947c-42a3-a286-1024a8c44921 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:41.308779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a90176-3f95-44c7-87da-d5b05c38ea6c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:41.346040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ed010-efa3-4163-9793-589b05d2adf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:41.347070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ed010-efa3-4163-9793-589b05d2adf1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:41.347546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ed010-efa3-4163-9793-589b05d2adf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:41.348036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ed010-efa3-4163-9793-589b05d2adf1 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:41.349083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ed010-efa3-4163-9793-589b05d2adf1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:41.349711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ed010-efa3-4163-9793-589b05d2adf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:41.351404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ed010-efa3-4163-9793-589b05d2adf1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:41.356877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 380/759] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 07:16:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:41.366352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ed010-efa3-4163-9793-589b05d2adf1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:41.413837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:41.428072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa82114-947c-42a3-a286-1024a8c44921 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:41.459730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:41.465115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca551fc0-b32f-44d8-843e-c1d47c3dad04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:41.465930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551fc0-b32f-44d8-843e-c1d47c3dad04 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:41.466379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551fc0-b32f-44d8-843e-c1d47c3dad04 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:41.466920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551fc0-b32f-44d8-843e-c1d47c3dad04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:41.479663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca551fc0-b32f-44d8-843e-c1d47c3dad04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ca551fc0-b32f-44d8-843e-c1d47c3dad04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:41.488136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:41.489095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:41.490756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 380/760] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:41.495930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca551fc0-b32f-44d8-843e-c1d47c3dad04 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:41.546253 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ed010-efa3-4163-9793-589b05d2adf1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:41.584593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f7c77-4ff8-49b6-afc1-18af0e6dcc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:41.584593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7c77-4ff8-49b6-afc1-18af0e6dcc27 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:41.584593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7c77-4ff8-49b6-afc1-18af0e6dcc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:41.584593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f7c77-4ff8-49b6-afc1-18af0e6dcc27 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:41.584978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f7c77-4ff8-49b6-afc1-18af0e6dcc27 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:41.584978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f7c77-4ff8-49b6-afc1-18af0e6dcc27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:41.585640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f7c77-4ff8-49b6-afc1-18af0e6dcc27 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:41.592499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 381/761] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 07:16:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:41.604499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f7c77-4ff8-49b6-afc1-18af0e6dcc27 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:41.613897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca551fc0-b32f-44d8-843e-c1d47c3dad04 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:41.652021 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66558a54-b946-4b17-bc02-21e043db0292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:41.652730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66558a54-b946-4b17-bc02-21e043db0292 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:41.655788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66558a54-b946-4b17-bc02-21e043db0292 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:41.656068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66558a54-b946-4b17-bc02-21e043db0292 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:41.656846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66558a54-b946-4b17-bc02-21e043db0292 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:41.657154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66558a54-b946-4b17-bc02-21e043db0292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:41.660502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66558a54-b946-4b17-bc02-21e043db0292 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:41.672675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 381/762] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:41.674144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66558a54-b946-4b17-bc02-21e043db0292 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:41.732044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:41.782857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66558a54-b946-4b17-bc02-21e043db0292 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:41.801567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:41.826254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924920b-827b-460d-98b1-ac8bcb776422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:41.827364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924920b-827b-460d-98b1-ac8bcb776422 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:41.828560 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924920b-827b-460d-98b1-ac8bcb776422 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:41.829544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1924920b-827b-460d-98b1-ac8bcb776422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:41.832311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f7c77-4ff8-49b6-afc1-18af0e6dcc27 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:41.853327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924920b-827b-460d-98b1-ac8bcb776422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:41.856177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1924920b-827b-460d-98b1-ac8bcb776422 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-1924920b-827b-460d-98b1-ac8bcb776422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:41.889052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:41.890188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:41.891307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:41.891307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:41.891307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:41.891307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:41.902656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 382/763] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:41.905293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924920b-827b-460d-98b1-ac8bcb776422 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:41.909753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bb35d-f1d0-44f3-aa78-fe98f302ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:41.910653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bb35d-f1d0-44f3-aa78-fe98f302ab8e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:41.911075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bb35d-f1d0-44f3-aa78-fe98f302ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:41.911567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bb35d-f1d0-44f3-aa78-fe98f302ab8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:41.912526 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bb35d-f1d0-44f3-aa78-fe98f302ab8e None admin] RBAC: Adding query filter params (interface=public, service_id=0cf9a2461fbf416e97d8ec53951dd6bc, region_id=RegionOne) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:41.913000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bb35d-f1d0-44f3-aa78-fe98f302ab8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:41.914901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649bb35d-f1d0-44f3-aa78-fe98f302ab8e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:41.931951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 382/764] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 07:16:41 2022] GET /identity/v3/endpoints?service_id=0cf9a2461fbf416e97d8ec53951dd6bc&interface=public®ion_id=RegionOne => generated 194 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:41.937728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bb35d-f1d0-44f3-aa78-fe98f302ab8e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:42.050177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1924920b-827b-460d-98b1-ac8bcb776422 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:42.055210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:42.084786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bb35d-f1d0-44f3-aa78-fe98f302ab8e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:42.098572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b9e82-b622-4ae2-827d-3881bd35f2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:42.100289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b9e82-b622-4ae2-827d-3881bd35f2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:42.100776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b9e82-b622-4ae2-827d-3881bd35f2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:42.101230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b9e82-b622-4ae2-827d-3881bd35f2b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:42.102157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b9e82-b622-4ae2-827d-3881bd35f2b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:42.102604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b9e82-b622-4ae2-827d-3881bd35f2b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:42.104161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b9e82-b622-4ae2-827d-3881bd35f2b0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:42.126067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 383/765] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:42.128045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b9e82-b622-4ae2-827d-3881bd35f2b0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:42.141187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335abb2-6893-4169-afaf-c0c19223e904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:42.141869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335abb2-6893-4169-afaf-c0c19223e904 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:42.142154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335abb2-6893-4169-afaf-c0c19223e904 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:42.142720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335abb2-6893-4169-afaf-c0c19223e904 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:42.143118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335abb2-6893-4169-afaf-c0c19223e904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:42.144518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335abb2-6893-4169-afaf-c0c19223e904 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:42.156919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 383/766] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 07:16:41 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:42.243173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b9e82-b622-4ae2-827d-3881bd35f2b0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:42.289637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90b532-a71c-4b17-aa92-bb5f9692f946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:42.290785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90b532-a71c-4b17-aa92-bb5f9692f946 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:42.291243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90b532-a71c-4b17-aa92-bb5f9692f946 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:42.291673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90b532-a71c-4b17-aa92-bb5f9692f946 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:42.305503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90b532-a71c-4b17-aa92-bb5f9692f946 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:42.307217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90b532-a71c-4b17-aa92-bb5f9692f946 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9e90b532-a71c-4b17-aa92-bb5f9692f946 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:42.330398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:42.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:42.332803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:42.340177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 384/767] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 07:16:42 2022] GET /identity/v3/users/nova => generated 82 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:42.345626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335abb2-6893-4169-afaf-c0c19223e904 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:42.385113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:42.485688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335abb2-6893-4169-afaf-c0c19223e904 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:42.520269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc3f6a-7d4d-4bf8-b897-0c9daaef5e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:42.521305 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3f6a-7d4d-4bf8-b897-0c9daaef5e10 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:42.521592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3f6a-7d4d-4bf8-b897-0c9daaef5e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:42.521868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc3f6a-7d4d-4bf8-b897-0c9daaef5e10 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:42.522712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3f6a-7d4d-4bf8-b897-0c9daaef5e10 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:42.523022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3f6a-7d4d-4bf8-b897-0c9daaef5e10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:42.524467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc3f6a-7d4d-4bf8-b897-0c9daaef5e10 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:42.543004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 384/768] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 07:16:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:42.548581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90b532-a71c-4b17-aa92-bb5f9692f946 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:42.585895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:42.611355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1d048-1a8a-4ad7-92af-908f11d51cdb None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:42.612116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1d048-1a8a-4ad7-92af-908f11d51cdb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:42.612911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce1d048-1a8a-4ad7-92af-908f11d51cdb None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:42.616325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 385/769] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:42.621455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f857e-68a5-4c7e-9d5f-89ca503bb506 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:42.622004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f857e-68a5-4c7e-9d5f-89ca503bb506 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:42.622616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f857e-68a5-4c7e-9d5f-89ca503bb506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:42.657096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-302f857e-68a5-4c7e-9d5f-89ca503bb506 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:42.658590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-302f857e-68a5-4c7e-9d5f-89ca503bb506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:42.700682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90b532-a71c-4b17-aa92-bb5f9692f946 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:42.765759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f68b-f6dc-4c29-83e1-a4d046d569e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:42.766568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f68b-f6dc-4c29-83e1-a4d046d569e0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:42.766852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f68b-f6dc-4c29-83e1-a4d046d569e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:42.767128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f5f68b-f6dc-4c29-83e1-a4d046d569e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:42.772391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 386/770] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:42 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:42.783326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5f68b-f6dc-4c29-83e1-a4d046d569e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:42.784818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f5f68b-f6dc-4c29-83e1-a4d046d569e0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-70f5f68b-f6dc-4c29-83e1-a4d046d569e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:42.803202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:42.804300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:42.805426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:42.805426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:42.805426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:42.805426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:42.807028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 385/771] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:42.810012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f857e-68a5-4c7e-9d5f-89ca503bb506 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:42.812888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f68b-f6dc-4c29-83e1-a4d046d569e0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:42.816605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:42.959791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f5f68b-f6dc-4c29-83e1-a4d046d569e0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:42.972844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:43.007757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e625-65d8-4d0c-82f7-f6f6bd475a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:43.007757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e625-65d8-4d0c-82f7-f6f6bd475a67 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.007757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e625-65d8-4d0c-82f7-f6f6bd475a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.007757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6e625-65d8-4d0c-82f7-f6f6bd475a67 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.008597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e625-65d8-4d0c-82f7-f6f6bd475a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:43.008597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e625-65d8-4d0c-82f7-f6f6bd475a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:43.009662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6e625-65d8-4d0c-82f7-f6f6bd475a67 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:43.012769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f857e-68a5-4c7e-9d5f-89ca503bb506 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:43.043790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 386/772] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:43.046333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e625-65d8-4d0c-82f7-f6f6bd475a67 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:43.077978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce139ff-9a42-4b7a-80ee-7b3a6c09985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:43.084534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce139ff-9a42-4b7a-80ee-7b3a6c09985b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.084534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce139ff-9a42-4b7a-80ee-7b3a6c09985b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.084534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce139ff-9a42-4b7a-80ee-7b3a6c09985b None admin] PATH_INFO: `/v3/services/network` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.084534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce139ff-9a42-4b7a-80ee-7b3a6c09985b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:43.084534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce139ff-9a42-4b7a-80ee-7b3a6c09985b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-4ce139ff-9a42-4b7a-80ee-7b3a6c09985b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:43.110844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:43.111923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:16:43.112793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:43.116345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 387/773] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:42 2022] GET /identity/v3/services/network => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:43.128282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce139ff-9a42-4b7a-80ee-7b3a6c09985b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:43.204169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:43.293902 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce139ff-9a42-4b7a-80ee-7b3a6c09985b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:43.319644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6e625-65d8-4d0c-82f7-f6f6bd475a67 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:43.366800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4d35d-b4ee-4002-92e9-3c71867bbffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:43.367493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4d35d-b4ee-4002-92e9-3c71867bbffc None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.367776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4d35d-b4ee-4002-92e9-3c71867bbffc None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.368055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d4d35d-b4ee-4002-92e9-3c71867bbffc None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.368818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4d35d-b4ee-4002-92e9-3c71867bbffc None admin] RBAC: Adding query filter params (name=network) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:43.369158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4d35d-b4ee-4002-92e9-3c71867bbffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:43.370608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d4d35d-b4ee-4002-92e9-3c71867bbffc None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:43.387230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 388/774] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:16:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:43.391592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856c54-d808-4b19-8994-e77c8c47e4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:43.393353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4d35d-b4ee-4002-92e9-3c71867bbffc None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:43.394277 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856c54-d808-4b19-8994-e77c8c47e4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.397887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856c54-d808-4b19-8994-e77c8c47e4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.398168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07856c54-d808-4b19-8994-e77c8c47e4f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.408903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:43.416154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856c54-d808-4b19-8994-e77c8c47e4f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:43.422515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07856c54-d808-4b19-8994-e77c8c47e4f2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-07856c54-d808-4b19-8994-e77c8c47e4f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:43.451198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:43.452178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:43.453132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:43.453132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:43.453132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:43.453132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:43.453132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:43.453132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:43.453132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:43.453132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:43.454964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 387/775] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:43.461662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856c54-d808-4b19-8994-e77c8c47e4f2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:43.630370 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d4d35d-b4ee-4002-92e9-3c71867bbffc None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:43.678056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:43.687089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385fd52b-6ed4-4ea1-b54c-62c9a1606c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:43.687760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fd52b-6ed4-4ea1-b54c-62c9a1606c46 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.688039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fd52b-6ed4-4ea1-b54c-62c9a1606c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.688311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385fd52b-6ed4-4ea1-b54c-62c9a1606c46 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.690286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fd52b-6ed4-4ea1-b54c-62c9a1606c46 None admin] RBAC: Adding query filter params (type=network) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:43.694925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07856c54-d808-4b19-8994-e77c8c47e4f2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:43.695041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fd52b-6ed4-4ea1-b54c-62c9a1606c46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:43.695131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385fd52b-6ed4-4ea1-b54c-62c9a1606c46 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:43.704081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 389/776] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:16:43 2022] GET /identity/v3/services?type=network => generated 350 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:43.705419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0ac5f-0a81-4dce-8d74-c1060fe87545 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.705704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0ac5f-0a81-4dce-8d74-c1060fe87545 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.705979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a0ac5f-0a81-4dce-8d74-c1060fe87545 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.714351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 390/777] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:43.716941 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0ac5f-0a81-4dce-8d74-c1060fe87545 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:43.757837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f1052-5cdf-4f75-9dfa-61f74e419280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:43.758638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f1052-5cdf-4f75-9dfa-61f74e419280 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.759428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f1052-5cdf-4f75-9dfa-61f74e419280 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.759725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f1052-5cdf-4f75-9dfa-61f74e419280 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.761003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f1052-5cdf-4f75-9dfa-61f74e419280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:43.761318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f1052-5cdf-4f75-9dfa-61f74e419280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:43.762998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777f1052-5cdf-4f75-9dfa-61f74e419280 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:43.782610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 388/778] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:43.783911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8b26-e005-4d3b-8e2b-cfa850696737 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.784197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8b26-e005-4d3b-8e2b-cfa850696737 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.784492 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b8b26-e005-4d3b-8e2b-cfa850696737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.806588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d18b8b26-e005-4d3b-8e2b-cfa850696737 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:43.807820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d18b8b26-e005-4d3b-8e2b-cfa850696737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:43.850250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a0ac5f-0a81-4dce-8d74-c1060fe87545 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:43.862315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:43.880375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 389/779] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:43.881736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a26d3-1948-4339-8060-c3ac7ef8d634 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.882031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a26d3-1948-4339-8060-c3ac7ef8d634 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.882288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a26d3-1948-4339-8060-c3ac7ef8d634 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.887706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 390/780] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:43.888496 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a26d3-1948-4339-8060-c3ac7ef8d634 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:43.889956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ea10e-8be0-4fe7-809a-18d73790cdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:43.890934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea10e-8be0-4fe7-809a-18d73790cdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.891277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea10e-8be0-4fe7-809a-18d73790cdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.891657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ea10e-8be0-4fe7-809a-18d73790cdf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.892638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea10e-8be0-4fe7-809a-18d73790cdf4 None admin] RBAC: Adding query filter params (interface=public, service_id=5abd12f7304b489dae61e2bcd56710a7, region_id=RegionOne) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:43.893025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea10e-8be0-4fe7-809a-18d73790cdf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:43.894501 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ea10e-8be0-4fe7-809a-18d73790cdf4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:43.905480 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 391/781] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 07:16:43 2022] GET /identity/v3/endpoints?service_id=5abd12f7304b489dae61e2bcd56710a7&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:43.905480 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4dc89-4920-44f8-8864-16a26544c23d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:43.905480 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4dc89-4920-44f8-8864-16a26544c23d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:43.905480 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc4dc89-4920-44f8-8864-16a26544c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:43.920673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1fc4dc89-4920-44f8-8864-16a26544c23d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:43.921858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1fc4dc89-4920-44f8-8864-16a26544c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:43.979860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:43.993799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 392/782] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:43.994589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4dc89-4920-44f8-8864-16a26544c23d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:44.015297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a26d3-1948-4339-8060-c3ac7ef8d634 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:44.054459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454dfb3-9d59-4d95-a4be-fe662105cbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:44.055350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454dfb3-9d59-4d95-a4be-fe662105cbcd None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.055632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454dfb3-9d59-4d95-a4be-fe662105cbcd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.055909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454dfb3-9d59-4d95-a4be-fe662105cbcd None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/3a06a84967694e68a3a77bf29f16ee3b/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.057924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454dfb3-9d59-4d95-a4be-fe662105cbcd None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=3a06a84967694e68a3a77bf29f16ee3b, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:44.059380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454dfb3-9d59-4d95-a4be-fe662105cbcd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:44.103885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc4dc89-4920-44f8-8864-16a26544c23d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:44.139222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74174-0bdc-47c2-8c96-ec524f919a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:44.139886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74174-0bdc-47c2-8c96-ec524f919a6d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.140170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74174-0bdc-47c2-8c96-ec524f919a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.140442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a74174-0bdc-47c2-8c96-ec524f919a6d None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.141158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a74174-0bdc-47c2-8c96-ec524f919a6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:44.142533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a74174-0bdc-47c2-8c96-ec524f919a6d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:44.152544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 391/783] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:16:43 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/3a06a84967694e68a3a77bf29f16ee3b/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:16:44.152544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454dfb3-9d59-4d95-a4be-fe662105cbcd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:44.159450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 393/784] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 07:16:43 2022] GET /identity/v3/services => generated 772 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:44.160380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74174-0bdc-47c2-8c96-ec524f919a6d None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:44.264052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:44.266527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:44.375572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a74174-0bdc-47c2-8c96-ec524f919a6d None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:44.398508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454dfb3-9d59-4d95-a4be-fe662105cbcd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:44.433399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ae555-b7bd-4aa5-86ef-74765088c9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:44.434312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae555-b7bd-4aa5-86ef-74765088c9a3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.434596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae555-b7bd-4aa5-86ef-74765088c9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.434868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1ae555-b7bd-4aa5-86ef-74765088c9a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.450882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d445aaa-d94b-41e4-a9d3-2514b3d66ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:44.451722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1ae555-b7bd-4aa5-86ef-74765088c9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:44.452255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d445aaa-d94b-41e4-a9d3-2514b3d66ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.452780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d445aaa-d94b-41e4-a9d3-2514b3d66ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.453259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d445aaa-d94b-41e4-a9d3-2514b3d66ac7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2a1ae555-b7bd-4aa5-86ef-74765088c9a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:44.461306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:44.462299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:44.463165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:44.468717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 394/785] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:44.470050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ae555-b7bd-4aa5-86ef-74765088c9a3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:44.473247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d445aaa-d94b-41e4-a9d3-2514b3d66ac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-4d445aaa-d94b-41e4-a9d3-2514b3d66ac7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:44.482266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:44.483221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:44.484078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:44.491125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 392/786] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:44.493311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d445aaa-d94b-41e4-a9d3-2514b3d66ac7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:44.595009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1ae555-b7bd-4aa5-86ef-74765088c9a3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:44.610773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:44.628169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d445aaa-d94b-41e4-a9d3-2514b3d66ac7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:44.636171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:44.641876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a2afe-64a9-4519-9f2e-d03dce21eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:44.642662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a2afe-64a9-4519-9f2e-d03dce21eb39 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.643041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a2afe-64a9-4519-9f2e-d03dce21eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.643425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a2afe-64a9-4519-9f2e-d03dce21eb39 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.644239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a2afe-64a9-4519-9f2e-d03dce21eb39 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:44.644620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a2afe-64a9-4519-9f2e-d03dce21eb39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:44.646608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a2afe-64a9-4519-9f2e-d03dce21eb39 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:44.665295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 395/787] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:44.670756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a2afe-64a9-4519-9f2e-d03dce21eb39 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:44.673927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022a877-00fc-49f0-8ebe-1d82400998d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:44.675462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a877-00fc-49f0-8ebe-1d82400998d1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.676625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a877-00fc-49f0-8ebe-1d82400998d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.678218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022a877-00fc-49f0-8ebe-1d82400998d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.681432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022a877-00fc-49f0-8ebe-1d82400998d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:44.683837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022a877-00fc-49f0-8ebe-1d82400998d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:44.685484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022a877-00fc-49f0-8ebe-1d82400998d1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:44.708603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 393/788] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:44.733002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022a877-00fc-49f0-8ebe-1d82400998d1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:44.847223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022a877-00fc-49f0-8ebe-1d82400998d1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:44.849352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a2afe-64a9-4519-9f2e-d03dce21eb39 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:44.894597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0211357-0b5c-4c57-98d0-6f42e91d48f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:44.897028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0211357-0b5c-4c57-98d0-6f42e91d48f8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.898724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0211357-0b5c-4c57-98d0-6f42e91d48f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.899010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0211357-0b5c-4c57-98d0-6f42e91d48f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.905482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224103e8-9abe-4dbd-88e7-e8ba570f1e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:44.906277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224103e8-9abe-4dbd-88e7-e8ba570f1e37 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.906556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224103e8-9abe-4dbd-88e7-e8ba570f1e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.906826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224103e8-9abe-4dbd-88e7-e8ba570f1e37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.925657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0211357-0b5c-4c57-98d0-6f42e91d48f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:44.927764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0211357-0b5c-4c57-98d0-6f42e91d48f8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:44.931729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224103e8-9abe-4dbd-88e7-e8ba570f1e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:44.933234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224103e8-9abe-4dbd-88e7-e8ba570f1e37 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c0211357-0b5c-4c57-98d0-6f42e91d48f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:44.951235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:44.952195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:44.953148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:44.953148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:44.953148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:44.953148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-224103e8-9abe-4dbd-88e7-e8ba570f1e37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:44.953371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:44.954288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:44.955195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:44.955195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:44.955195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:44.955195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:44.955195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 396/789] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:44.955480 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab481bc-16dd-4ae1-ab2f-2234be618ac5 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.956338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab481bc-16dd-4ae1-ab2f-2234be618ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.956338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab481bc-16dd-4ae1-ab2f-2234be618ac5 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.960554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 397/790] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:44.960554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab481bc-16dd-4ae1-ab2f-2234be618ac5 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:44.964736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 394/791] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:44.966310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fb6d2-5692-485c-b317-0741e0da2570 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:44.967295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fb6d2-5692-485c-b317-0741e0da2570 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:44.967837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69fb6d2-5692-485c-b317-0741e0da2570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:44.991125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c69fb6d2-5692-485c-b317-0741e0da2570 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:44.993415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c69fb6d2-5692-485c-b317-0741e0da2570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:45.012542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:45.021062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:45.088706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 395/792] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:45.089779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fb6d2-5692-485c-b317-0741e0da2570 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.090166 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab481bc-16dd-4ae1-ab2f-2234be618ac5 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:45.144100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f66bd8-3ac7-4022-99c0-2a8ec110577f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:45.144908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f66bd8-3ac7-4022-99c0-2a8ec110577f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:45.145135 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f66bd8-3ac7-4022-99c0-2a8ec110577f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:45.145411 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f66bd8-3ac7-4022-99c0-2a8ec110577f None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:45.146730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f66bd8-3ac7-4022-99c0-2a8ec110577f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:45.147037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f66bd8-3ac7-4022-99c0-2a8ec110577f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:45.148436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f66bd8-3ac7-4022-99c0-2a8ec110577f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:45.164823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 398/793] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:45.165792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f66bd8-3ac7-4022-99c0-2a8ec110577f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.230036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69fb6d2-5692-485c-b317-0741e0da2570 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:45.277154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1962bd-238a-4494-8de4-4061bdb66eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:45.278392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1962bd-238a-4494-8de4-4061bdb66eae None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:45.279140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1962bd-238a-4494-8de4-4061bdb66eae None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:45.280034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:45.280844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1962bd-238a-4494-8de4-4061bdb66eae None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:45.281818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1962bd-238a-4494-8de4-4061bdb66eae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:45.282328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1962bd-238a-4494-8de4-4061bdb66eae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:45.284376 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1962bd-238a-4494-8de4-4061bdb66eae None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:45.299716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f66bd8-3ac7-4022-99c0-2a8ec110577f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:45.301914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 396/794] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:45.301914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1962bd-238a-4494-8de4-4061bdb66eae None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.316437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:45.347576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d003834-2702-44f4-91f3-811fc7ad4d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:45.350061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003834-2702-44f4-91f3-811fc7ad4d5f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:45.350614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003834-2702-44f4-91f3-811fc7ad4d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:45.351719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d003834-2702-44f4-91f3-811fc7ad4d5f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:45.352613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d003834-2702-44f4-91f3-811fc7ad4d5f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:45.354321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d003834-2702-44f4-91f3-811fc7ad4d5f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6d003834-2702-44f4-91f3-811fc7ad4d5f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:45.368316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:45.369297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:16:45.370161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:45.377846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 399/795] 10.222.0.24 () {56 vars in 1129 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:45.379112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d003834-2702-44f4-91f3-811fc7ad4d5f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.410232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1962bd-238a-4494-8de4-4061bdb66eae None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:45.446637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c0bc-cb35-4d71-8ad2-dee13ad50fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:45.447430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c0bc-cb35-4d71-8ad2-dee13ad50fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:45.447788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c0bc-cb35-4d71-8ad2-dee13ad50fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:45.447970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f42c0bc-cb35-4d71-8ad2-dee13ad50fb2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:45.456097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42c0bc-cb35-4d71-8ad2-dee13ad50fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:45.457555 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f42c0bc-cb35-4d71-8ad2-dee13ad50fb2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-5f42c0bc-cb35-4d71-8ad2-dee13ad50fb2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:45.472778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:45.474326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:45.475723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 397/796] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:45.476328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c0bc-cb35-4d71-8ad2-dee13ad50fb2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.497755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d003834-2702-44f4-91f3-811fc7ad4d5f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:45.540378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4711-e906-4838-8a9c-92f7080a7897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:45.541736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4711-e906-4838-8a9c-92f7080a7897 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:45.542326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4711-e906-4838-8a9c-92f7080a7897 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:45.542913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edae4711-e906-4838-8a9c-92f7080a7897 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:45.553947 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:45.556413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae4711-e906-4838-8a9c-92f7080a7897 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:45.558138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edae4711-e906-4838-8a9c-92f7080a7897 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-edae4711-e906-4838-8a9c-92f7080a7897 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:45.579554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:45.580619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:16:45.581643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:45.587850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 400/797] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:45.588935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4711-e906-4838-8a9c-92f7080a7897 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.598031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f42c0bc-cb35-4d71-8ad2-dee13ad50fb2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:45.610465 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:45.646664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754a82-09b6-4c66-9aa1-92562e479726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:45.648180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754a82-09b6-4c66-9aa1-92562e479726 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:45.648794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754a82-09b6-4c66-9aa1-92562e479726 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:45.649278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754a82-09b6-4c66-9aa1-92562e479726 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:45.650359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a754a82-09b6-4c66-9aa1-92562e479726 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:45.651165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a754a82-09b6-4c66-9aa1-92562e479726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:45.652773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a754a82-09b6-4c66-9aa1-92562e479726 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:45.664898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 398/798] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:45.664898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754a82-09b6-4c66-9aa1-92562e479726 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.713402 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edae4711-e906-4838-8a9c-92f7080a7897 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:45.751575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4328a43-91aa-47c5-98e4-1ffccde25fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:45.752487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4328a43-91aa-47c5-98e4-1ffccde25fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:45.752910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4328a43-91aa-47c5-98e4-1ffccde25fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:45.753178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4328a43-91aa-47c5-98e4-1ffccde25fe8 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:45.754007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4328a43-91aa-47c5-98e4-1ffccde25fe8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:45.754309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4328a43-91aa-47c5-98e4-1ffccde25fe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:45.755862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4328a43-91aa-47c5-98e4-1ffccde25fe8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:45.779074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 401/799] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:45.780764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4328a43-91aa-47c5-98e4-1ffccde25fe8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.793898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754a82-09b6-4c66-9aa1-92562e479726 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:45.829369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8b229-607d-4aa5-ab1c-835f070c6d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:45.830092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8b229-607d-4aa5-ab1c-835f070c6d0a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:45.830371 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8b229-607d-4aa5-ab1c-835f070c6d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:45.830641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d8b229-607d-4aa5-ab1c-835f070c6d0a None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:45.831572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8b229-607d-4aa5-ab1c-835f070c6d0a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:45.831881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8b229-607d-4aa5-ab1c-835f070c6d0a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:45.833961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d8b229-607d-4aa5-ab1c-835f070c6d0a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:45.836026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:45.855908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 399/800] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:45.857079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8b229-607d-4aa5-ab1c-835f070c6d0a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.873624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:45.912115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4328a43-91aa-47c5-98e4-1ffccde25fe8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:45.948344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c18c-5364-4f83-b562-35627914da3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:45.949157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c18c-5364-4f83-b562-35627914da3e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:45.949440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c18c-5364-4f83-b562-35627914da3e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:45.949718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c74c18c-5364-4f83-b562-35627914da3e None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:45.950420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74c18c-5364-4f83-b562-35627914da3e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:45.950724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74c18c-5364-4f83-b562-35627914da3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:45.952202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c74c18c-5364-4f83-b562-35627914da3e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:45.963090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 402/801] 10.222.0.24 () {56 vars in 1124 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:45.963090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c18c-5364-4f83-b562-35627914da3e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:45.994400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d8b229-607d-4aa5-ab1c-835f070c6d0a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:46.041435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d66031-7e15-4db5-affe-fd2f8955cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:46.043140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d66031-7e15-4db5-affe-fd2f8955cdab None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.043653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d66031-7e15-4db5-affe-fd2f8955cdab None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.044529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d66031-7e15-4db5-affe-fd2f8955cdab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.058704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d66031-7e15-4db5-affe-fd2f8955cdab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:46.061000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d66031-7e15-4db5-affe-fd2f8955cdab None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:46.071884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c74c18c-5364-4f83-b562-35627914da3e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-83d66031-7e15-4db5-affe-fd2f8955cdab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:46.084427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:46.085399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:46.086316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:46.086316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:46.086316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:46.086316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:46.089553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 400/802] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:46.090632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d66031-7e15-4db5-affe-fd2f8955cdab None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:46.106719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:46.112619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2611a-c773-4aad-a97f-39bb904b12a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:46.113615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2611a-c773-4aad-a97f-39bb904b12a6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.114037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2611a-c773-4aad-a97f-39bb904b12a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.114965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca2611a-c773-4aad-a97f-39bb904b12a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.125812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2611a-c773-4aad-a97f-39bb904b12a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:46.127467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca2611a-c773-4aad-a97f-39bb904b12a6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:46.142915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2ca2611a-c773-4aad-a97f-39bb904b12a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:46.147989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:46.149023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:46.149928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:46.149928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:46.149928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:46.149928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:46.156535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 403/803] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:46.159013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2611a-c773-4aad-a97f-39bb904b12a6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:46.203959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d66031-7e15-4db5-affe-fd2f8955cdab None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:46.243485 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de8511-daca-4d4f-a49f-3124da0b5f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:46.244355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de8511-daca-4d4f-a49f-3124da0b5f43 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.244974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de8511-daca-4d4f-a49f-3124da0b5f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.245314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de8511-daca-4d4f-a49f-3124da0b5f43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.246286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de8511-daca-4d4f-a49f-3124da0b5f43 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:46.248287 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de8511-daca-4d4f-a49f-3124da0b5f43 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:46.268490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca2611a-c773-4aad-a97f-39bb904b12a6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:46.305359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2d6d-7150-4457-b38e-856b7a6368b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:46.306207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2d6d-7150-4457-b38e-856b7a6368b5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.306488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2d6d-7150-4457-b38e-856b7a6368b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.306754 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b2d6d-7150-4457-b38e-856b7a6368b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.307474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b2d6d-7150-4457-b38e-856b7a6368b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:46.307778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b2d6d-7150-4457-b38e-856b7a6368b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:46.309295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b2d6d-7150-4457-b38e-856b7a6368b5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:46.321830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 404/804] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:46.322420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2d6d-7150-4457-b38e-856b7a6368b5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:46.369247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 401/805] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 07:16:46 2022] POST /identity/v3/endpoints => generated 346 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:46.370305 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de8511-daca-4d4f-a49f-3124da0b5f43 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:46.385337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:46.504414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b2d6d-7150-4457-b38e-856b7a6368b5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:46.592703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:46.597706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fe655-8665-45eb-96f2-5a5c6e8ba784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:46.598518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fe655-8665-45eb-96f2-5a5c6e8ba784 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.605373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de8511-daca-4d4f-a49f-3124da0b5f43 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:46.605518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fe655-8665-45eb-96f2-5a5c6e8ba784 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.605518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6fe655-8665-45eb-96f2-5a5c6e8ba784 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.605518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fe655-8665-45eb-96f2-5a5c6e8ba784 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:46.605518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fe655-8665-45eb-96f2-5a5c6e8ba784 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:46.605518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6fe655-8665-45eb-96f2-5a5c6e8ba784 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:46.626986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 405/806] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:46.632550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fe655-8665-45eb-96f2-5a5c6e8ba784 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:46.655666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526e4ae4-ea18-4c49-b77f-a36150125ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:46.655666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e4ae4-ea18-4c49-b77f-a36150125ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.655965 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e4ae4-ea18-4c49-b77f-a36150125ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.656041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526e4ae4-ea18-4c49-b77f-a36150125ad0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.666026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e4ae4-ea18-4c49-b77f-a36150125ad0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:46.667746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526e4ae4-ea18-4c49-b77f-a36150125ad0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-526e4ae4-ea18-4c49-b77f-a36150125ad0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:46.687713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:46.688694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:46.690011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:46.690011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:46.690011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:46.690011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:46.690011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:46.690011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:46.690011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:46.690011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:46.690011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 402/807] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:46.691004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93edf1-9d30-48b8-a3c8-6823ae36cf61 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.691198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93edf1-9d30-48b8-a3c8-6823ae36cf61 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.691478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da93edf1-9d30-48b8-a3c8-6823ae36cf61 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.693665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 403/808] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:46.699579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082b4fd-d922-4c52-94cd-bd554fcae0b1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.699823 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082b4fd-d922-4c52-94cd-bd554fcae0b1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.700105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082b4fd-d922-4c52-94cd-bd554fcae0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.719317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b082b4fd-d922-4c52-94cd-bd554fcae0b1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:46.720588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b082b4fd-d922-4c52-94cd-bd554fcae0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:46.759952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:46.763025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6fe655-8665-45eb-96f2-5a5c6e8ba784 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:46.792629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 404/809] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:46.792629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082b4fd-d922-4c52-94cd-bd554fcae0b1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:46.801192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93ad5d-3836-43c3-a92c-82945bb31154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:46.803065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93ad5d-3836-43c3-a92c-82945bb31154 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.803653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93ad5d-3836-43c3-a92c-82945bb31154 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.804267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93ad5d-3836-43c3-a92c-82945bb31154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.812183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93ad5d-3836-43c3-a92c-82945bb31154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:46.813694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93ad5d-3836-43c3-a92c-82945bb31154 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-8b93ad5d-3836-43c3-a92c-82945bb31154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:46.830027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:46.831035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:46.831913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:46.831913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:46.831913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:46.831913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:46.831913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:46.831913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:46.831913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:46.831913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:46.831913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 406/810] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:46.833111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2173c-02a4-4c22-b563-88780950e738 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.833520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2173c-02a4-4c22-b563-88780950e738 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.833837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2173c-02a4-4c22-b563-88780950e738 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.835438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 407/811] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:46.836144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2173c-02a4-4c22-b563-88780950e738 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:46.903247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:46.913406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082b4fd-d922-4c52-94cd-bd554fcae0b1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:46.949629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43dd58-7c00-4bd0-98f2-a6a2446d9434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:46.949946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2173c-02a4-4c22-b563-88780950e738 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:46.950402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43dd58-7c00-4bd0-98f2-a6a2446d9434 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.950578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43dd58-7c00-4bd0-98f2-a6a2446d9434 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.950836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e43dd58-7c00-4bd0-98f2-a6a2446d9434 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:46.951807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43dd58-7c00-4bd0-98f2-a6a2446d9434 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:46.952726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43dd58-7c00-4bd0-98f2-a6a2446d9434 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:46.954339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e43dd58-7c00-4bd0-98f2-a6a2446d9434 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:46.971315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 405/812] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:46.971315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43dd58-7c00-4bd0-98f2-a6a2446d9434 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:46.991012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d16d0d-c75c-4ca3-9270-de0552221d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:46.991809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16d0d-c75c-4ca3-9270-de0552221d51 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:46.992090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16d0d-c75c-4ca3-9270-de0552221d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:46.992367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16d0d-c75c-4ca3-9270-de0552221d51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:47.003709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d16d0d-c75c-4ca3-9270-de0552221d51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-b3d16d0d-c75c-4ca3-9270-de0552221d51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:47.011855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:47.012899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:47.013752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 408/813] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:47.014822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e8d1c-0144-437a-a0d9-7606d7c7e86c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:47.014921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e8d1c-0144-437a-a0d9-7606d7c7e86c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:47.015134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4e8d1c-0144-437a-a0d9-7606d7c7e86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:47.033686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2c4e8d1c-0144-437a-a0d9-7606d7c7e86c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:47.034844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2c4e8d1c-0144-437a-a0d9-7606d7c7e86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:47.050260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:47.081318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e43dd58-7c00-4bd0-98f2-a6a2446d9434 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:47.116189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b0a4-5bef-4d4e-b272-fdf1d1627ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:47.116740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 409/814] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:47.116956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b0a4-5bef-4d4e-b272-fdf1d1627ce9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:47.117172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b0a4-5bef-4d4e-b272-fdf1d1627ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:47.117445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261b0a4-5bef-4d4e-b272-fdf1d1627ce9 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:47.117561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e8d1c-0144-437a-a0d9-7606d7c7e86c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:47.118373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261b0a4-5bef-4d4e-b272-fdf1d1627ce9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:47.118690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261b0a4-5bef-4d4e-b272-fdf1d1627ce9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:47.120117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261b0a4-5bef-4d4e-b272-fdf1d1627ce9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:47.134111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 406/815] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:47.134930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b0a4-5bef-4d4e-b272-fdf1d1627ce9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:47.147918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:47.225618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4e8d1c-0144-437a-a0d9-7606d7c7e86c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:47.241986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261b0a4-5bef-4d4e-b272-fdf1d1627ce9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:47.262707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662d24-cb7c-4959-98ba-296d6fe3a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:47.263952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662d24-cb7c-4959-98ba-296d6fe3a555 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:47.264384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662d24-cb7c-4959-98ba-296d6fe3a555 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:47.264807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9662d24-cb7c-4959-98ba-296d6fe3a555 None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/b54767b9f07341c3aa2ba9a120a62ed0/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:47.267496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9662d24-cb7c-4959-98ba-296d6fe3a555 None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=b54767b9f07341c3aa2ba9a120a62ed0, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:47.269450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9662d24-cb7c-4959-98ba-296d6fe3a555 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:47.276959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e9ce1-5645-43d6-92d7-8e33568190d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:47.277628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9ce1-5645-43d6-92d7-8e33568190d3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:47.277907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9ce1-5645-43d6-92d7-8e33568190d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:47.278179 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55e9ce1-5645-43d6-92d7-8e33568190d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:47.278929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e9ce1-5645-43d6-92d7-8e33568190d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:47.279236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e9ce1-5645-43d6-92d7-8e33568190d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:47.280706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55e9ce1-5645-43d6-92d7-8e33568190d3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:47.289436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 407/816] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:47.290296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e9ce1-5645-43d6-92d7-8e33568190d3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:47.340373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 410/817] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:16:47 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/b54767b9f07341c3aa2ba9a120a62ed0/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:16:47.341826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662d24-cb7c-4959-98ba-296d6fe3a555 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:47.359429 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:47.378714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:47.424709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55e9ce1-5645-43d6-92d7-8e33568190d3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:47.470690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9662d24-cb7c-4959-98ba-296d6fe3a555 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:47.477213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ed389-ccd9-49bf-867b-e2220b2ca8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:47.478028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ed389-ccd9-49bf-867b-e2220b2ca8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:47.478310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ed389-ccd9-49bf-867b-e2220b2ca8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:47.478581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ed389-ccd9-49bf-867b-e2220b2ca8b5 None admin] PATH_INFO: `/v3/services/network` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:47.479244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ed389-ccd9-49bf-867b-e2220b2ca8b5 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:47.480660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ed389-ccd9-49bf-867b-e2220b2ca8b5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-617ed389-ccd9-49bf-867b-e2220b2ca8b5 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:47.497814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:47.498945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:16:47.499810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:47.504528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 408/818] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:47 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:47.506045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ed389-ccd9-49bf-867b-e2220b2ca8b5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:47.519326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e0179-dab1-4791-ab4d-7237b6738eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:47.521251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e0179-dab1-4791-ab4d-7237b6738eeb None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:47.521932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e0179-dab1-4791-ab4d-7237b6738eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:47.522466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92e0179-dab1-4791-ab4d-7237b6738eeb None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/442cda3fdb25400a8cdab1655717b1e5/roles/94ab939081724a88a65a1961cc1826b8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:47.540771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e0179-dab1-4791-ab4d-7237b6738eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=442cda3fdb25400a8cdab1655717b1e5, role_id=94ab939081724a88a65a1961cc1826b8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:47.542612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92e0179-dab1-4791-ab4d-7237b6738eeb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:47.613761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 411/819] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:16:47 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/442cda3fdb25400a8cdab1655717b1e5/roles/94ab939081724a88a65a1961cc1826b8 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:16:47.615333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e0179-dab1-4791-ab4d-7237b6738eeb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:47.643459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ed389-ccd9-49bf-867b-e2220b2ca8b5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:47.725063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:47.726017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756eebe-e3f2-4f6d-878a-e43821ed897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:47.726997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756eebe-e3f2-4f6d-878a-e43821ed897a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:47.727306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756eebe-e3f2-4f6d-878a-e43821ed897a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:47.727674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a756eebe-e3f2-4f6d-878a-e43821ed897a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:47.735313 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:47.751313 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756eebe-e3f2-4f6d-878a-e43821ed897a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:47.752929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a756eebe-e3f2-4f6d-878a-e43821ed897a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:47.771184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92e0179-dab1-4791-ab4d-7237b6738eeb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a756eebe-e3f2-4f6d-878a-e43821ed897a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:47.781254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:47.782617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:47.783738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:47.783738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:47.783738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:47.783738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:47.785973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 409/820] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:47.792750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756eebe-e3f2-4f6d-878a-e43821ed897a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:47.826074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9dff3-2704-4869-aef7-150d954adeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:47.827004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9dff3-2704-4869-aef7-150d954adeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:47.827431 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9dff3-2704-4869-aef7-150d954adeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:47.827900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9dff3-2704-4869-aef7-150d954adeb3 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:47.828786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9dff3-2704-4869-aef7-150d954adeb3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:47.830550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9dff3-2704-4869-aef7-150d954adeb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:47.832381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9dff3-2704-4869-aef7-150d954adeb3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:47.842567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 412/821] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:16:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:47.848303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9dff3-2704-4869-aef7-150d954adeb3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:47.972371 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a756eebe-e3f2-4f6d-878a-e43821ed897a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:47.990575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9dff3-2704-4869-aef7-150d954adeb3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:48.010064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e1644-2c77-443b-9473-0615308bcbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:48.010957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e1644-2c77-443b-9473-0615308bcbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:48.011383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e1644-2c77-443b-9473-0615308bcbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:48.011890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e1644-2c77-443b-9473-0615308bcbe8 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:48.012919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e1644-2c77-443b-9473-0615308bcbe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:48.013366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e1644-2c77-443b-9473-0615308bcbe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:48.014881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0e1644-2c77-443b-9473-0615308bcbe8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:48.019912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:48.029119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 410/822] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:48.032462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87783c2b-ea01-4c06-81c3-184899d81058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:48.037245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783c2b-ea01-4c06-81c3-184899d81058 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:48.037245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783c2b-ea01-4c06-81c3-184899d81058 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:48.037245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87783c2b-ea01-4c06-81c3-184899d81058 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:48.037520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e1644-2c77-443b-9473-0615308bcbe8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:48.037618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87783c2b-ea01-4c06-81c3-184899d81058 None admin] RBAC: Adding query filter params (type=network) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:48.037618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87783c2b-ea01-4c06-81c3-184899d81058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:48.037618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87783c2b-ea01-4c06-81c3-184899d81058 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:48.043801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 413/823] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:16:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:48.049059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87783c2b-ea01-4c06-81c3-184899d81058 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:48.122953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:48.206684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87783c2b-ea01-4c06-81c3-184899d81058 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:48.216913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e1644-2c77-443b-9473-0615308bcbe8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:48.243891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85658e-dc4a-4e4e-b3a1-16d4e0c6cb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:48.244625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85658e-dc4a-4e4e-b3a1-16d4e0c6cb7b None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:48.244923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85658e-dc4a-4e4e-b3a1-16d4e0c6cb7b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:48.245205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df85658e-dc4a-4e4e-b3a1-16d4e0c6cb7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:48.245951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85658e-dc4a-4e4e-b3a1-16d4e0c6cb7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:48.247388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df85658e-dc4a-4e4e-b3a1-16d4e0c6cb7b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:48.274453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca904d-4463-4a57-833d-80274062f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:48.275248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca904d-4463-4a57-833d-80274062f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:48.275605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca904d-4463-4a57-833d-80274062f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:48.275889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca904d-4463-4a57-833d-80274062f1d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:48.290271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca904d-4463-4a57-833d-80274062f1d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:48.290271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca904d-4463-4a57-833d-80274062f1d9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-83ca904d-4463-4a57-833d-80274062f1d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:48.301231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:48.302502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:48.303610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 411/824] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 07:16:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:48.310949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca904d-4463-4a57-833d-80274062f1d9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:48.388557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 414/825] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 07:16:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:16:48.428644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca904d-4463-4a57-833d-80274062f1d9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:48.439013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:48.472720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb97ce2-b53c-4f3f-8364-f73dd854b0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:48.473411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb97ce2-b53c-4f3f-8364-f73dd854b0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:48.474226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb97ce2-b53c-4f3f-8364-f73dd854b0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:48.474504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb97ce2-b53c-4f3f-8364-f73dd854b0a7 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:48.475456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb97ce2-b53c-4f3f-8364-f73dd854b0a7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:48.475853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb97ce2-b53c-4f3f-8364-f73dd854b0a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:48.477865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb97ce2-b53c-4f3f-8364-f73dd854b0a7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:48.498270 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 412/826] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 07:16:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:48.503847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85658e-dc4a-4e4e-b3a1-16d4e0c6cb7b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:48.578245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:48.645709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df85658e-dc4a-4e4e-b3a1-16d4e0c6cb7b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:48.682401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b7313-c51f-42e5-b479-4ecd20e162c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:48.683293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7313-c51f-42e5-b479-4ecd20e162c1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:48.683785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7313-c51f-42e5-b479-4ecd20e162c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:48.684217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b7313-c51f-42e5-b479-4ecd20e162c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:48.763132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b7313-c51f-42e5-b479-4ecd20e162c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:48.765205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b7313-c51f-42e5-b479-4ecd20e162c1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:48.820494 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:48.886086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 415/827] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:48 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:16:48.891399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb97ce2-b53c-4f3f-8364-f73dd854b0a7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:49.000636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb97ce2-b53c-4f3f-8364-f73dd854b0a7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:49.017652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3909f-275c-4551-b070-924ce9eb8f3e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.018593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3909f-275c-4551-b070-924ce9eb8f3e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.018874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a3909f-275c-4551-b070-924ce9eb8f3e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.020928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 416/828] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:16:49.027231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d28f2-834f-4695-acb4-77027215d9e3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.027817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d28f2-834f-4695-acb4-77027215d9e3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.028306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098d28f2-834f-4695-acb4-77027215d9e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.043944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9587-3470-4907-82d9-1f8da2014468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:49.044802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9587-3470-4907-82d9-1f8da2014468 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.045166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9587-3470-4907-82d9-1f8da2014468 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.045439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268a9587-3470-4907-82d9-1f8da2014468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.052740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-098d28f2-834f-4695-acb4-77027215d9e3 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:49.053934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-098d28f2-834f-4695-acb4-77027215d9e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:49.058615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9587-3470-4907-82d9-1f8da2014468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:49.060072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268a9587-3470-4907-82d9-1f8da2014468 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-268a9587-3470-4907-82d9-1f8da2014468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:49.079799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:49.080919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:49.082123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:49.082123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:49.082123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:49.082123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:49.082123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 413/829] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:49.089281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9587-3470-4907-82d9-1f8da2014468 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:49.107844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:49.132829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 417/830] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:49.155419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d28f2-834f-4695-acb4-77027215d9e3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:49.203474 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268a9587-3470-4907-82d9-1f8da2014468 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:49.232834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:49.244985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d24fb-56c8-4b3c-aacf-4ab1ae060e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:49.245747 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d24fb-56c8-4b3c-aacf-4ab1ae060e04 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.246079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d24fb-56c8-4b3c-aacf-4ab1ae060e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.246480 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d24fb-56c8-4b3c-aacf-4ab1ae060e04 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.247581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d24fb-56c8-4b3c-aacf-4ab1ae060e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:49.247904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d24fb-56c8-4b3c-aacf-4ab1ae060e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:49.249297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d24fb-56c8-4b3c-aacf-4ab1ae060e04 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:49.265270 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098d28f2-834f-4695-acb4-77027215d9e3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:49.268888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 414/831] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:49.269560 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d24fb-56c8-4b3c-aacf-4ab1ae060e04 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:49.309992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb4a3-f406-42c9-a4c2-7f3edb1a1229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:49.311861 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb4a3-f406-42c9-a4c2-7f3edb1a1229 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.312335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb4a3-f406-42c9-a4c2-7f3edb1a1229 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.312814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efcb4a3-f406-42c9-a4c2-7f3edb1a1229 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.313759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcb4a3-f406-42c9-a4c2-7f3edb1a1229 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:49.315434 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efcb4a3-f406-42c9-a4c2-7f3edb1a1229 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-9efcb4a3-f406-42c9-a4c2-7f3edb1a1229 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:49.330577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:49.331613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:16:49.332450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:49.334463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 418/832] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:49.339532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb4a3-f406-42c9-a4c2-7f3edb1a1229 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:49.367144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:49.403320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d24fb-56c8-4b3c-aacf-4ab1ae060e04 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:49.440317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa5c2f-f06e-4bd6-954c-a97d6d99b844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:49.441154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa5c2f-f06e-4bd6-954c-a97d6d99b844 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.441435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa5c2f-f06e-4bd6-954c-a97d6d99b844 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.441762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fa5c2f-f06e-4bd6-954c-a97d6d99b844 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.452134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa5c2f-f06e-4bd6-954c-a97d6d99b844 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:49.454131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fa5c2f-f06e-4bd6-954c-a97d6d99b844 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:49.457585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efcb4a3-f406-42c9-a4c2-7f3edb1a1229 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-77fa5c2f-f06e-4bd6-954c-a97d6d99b844 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:49.473684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:49.474629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:49.475524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:49.475524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:49.475524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:49.475524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:49.475524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:49.475524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:49.475524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:49.475524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:49.480350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 415/833] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:49.481246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa5c2f-f06e-4bd6-954c-a97d6d99b844 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:49.504054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666dbdd-cc51-4287-8120-ff7627fb4ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:49.505317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666dbdd-cc51-4287-8120-ff7627fb4ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.506025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666dbdd-cc51-4287-8120-ff7627fb4ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.506232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666dbdd-cc51-4287-8120-ff7627fb4ad0 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.506983 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666dbdd-cc51-4287-8120-ff7627fb4ad0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:49.507366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666dbdd-cc51-4287-8120-ff7627fb4ad0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:49.508833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666dbdd-cc51-4287-8120-ff7627fb4ad0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:49.518772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 419/834] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:49.519643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666dbdd-cc51-4287-8120-ff7627fb4ad0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:49.523594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:49.605108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fa5c2f-f06e-4bd6-954c-a97d6d99b844 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:49.628267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666dbdd-cc51-4287-8120-ff7627fb4ad0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:49.643806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f654e5-754d-46c9-924f-1e4094b59621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:49.644589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f654e5-754d-46c9-924f-1e4094b59621 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.644940 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f654e5-754d-46c9-924f-1e4094b59621 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.645277 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f654e5-754d-46c9-924f-1e4094b59621 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.646750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f654e5-754d-46c9-924f-1e4094b59621 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:49.647122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f654e5-754d-46c9-924f-1e4094b59621 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:49.648717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f654e5-754d-46c9-924f-1e4094b59621 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:49.650515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:49.663325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 416/835] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:49.669129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f654e5-754d-46c9-924f-1e4094b59621 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:49.670126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a969d58-9436-48f5-9e66-21eaea12f70c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:49.670881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a969d58-9436-48f5-9e66-21eaea12f70c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.671304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a969d58-9436-48f5-9e66-21eaea12f70c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.671591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a969d58-9436-48f5-9e66-21eaea12f70c None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.672311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a969d58-9436-48f5-9e66-21eaea12f70c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:49.672823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a969d58-9436-48f5-9e66-21eaea12f70c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:49.674546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a969d58-9436-48f5-9e66-21eaea12f70c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:49.689128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 420/836] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:49 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:49.792774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f654e5-754d-46c9-924f-1e4094b59621 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:49.831864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684a865-5a28-412d-a576-17236a4a6ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:49.833522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a865-5a28-412d-a576-17236a4a6ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.833955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a865-5a28-412d-a576-17236a4a6ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.834375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684a865-5a28-412d-a576-17236a4a6ff7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.835445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684a865-5a28-412d-a576-17236a4a6ff7 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=3a06a84967694e68a3a77bf29f16ee3b) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:49.835935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684a865-5a28-412d-a576-17236a4a6ff7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:49.837706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684a865-5a28-412d-a576-17236a4a6ff7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:49.845614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 417/837] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:49 2022] GET /identity/v3/role_assignments?user.id=3a06a84967694e68a3a77bf29f16ee3b&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=7c09d078126441909df0a46212ffea63 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:49.941198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a58ca-a917-4422-9ef5-cd7c6f075c50 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.941657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a58ca-a917-4422-9ef5-cd7c6f075c50 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.942035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476a58ca-a917-4422-9ef5-cd7c6f075c50 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.944751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 421/838] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:49.950837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d43f-6320-4fdb-aeff-7f7b5a57b332 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:49.951374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d43f-6320-4fdb-aeff-7f7b5a57b332 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:49.951628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7295d43f-6320-4fdb-aeff-7f7b5a57b332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:49.971079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7295d43f-6320-4fdb-aeff-7f7b5a57b332 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:49.972283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7295d43f-6320-4fdb-aeff-7f7b5a57b332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:50.034949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:50.051760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 418/839] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:49 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:50.076820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a58ca-a917-4422-9ef5-cd7c6f075c50 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:50.137127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691c8c9-3d06-4fc6-9004-331a7c0d2374 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:50.137784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691c8c9-3d06-4fc6-9004-331a7c0d2374 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:50.138258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691c8c9-3d06-4fc6-9004-331a7c0d2374 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:50.140562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 419/840] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:16:50.146103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe7d8-e08f-49d8-a5f1-35b7329d9de2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:50.146446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe7d8-e08f-49d8-a5f1-35b7329d9de2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:50.146725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffe7d8-e08f-49d8-a5f1-35b7329d9de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:50.154353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:50.163975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-13ffe7d8-e08f-49d8-a5f1-35b7329d9de2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:50.165194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-13ffe7d8-e08f-49d8-a5f1-35b7329d9de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:50.209689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476a58ca-a917-4422-9ef5-cd7c6f075c50 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:50.249895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 420/841] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:50 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:50.255167 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea318cc-72df-4918-bce3-e175e6a4f403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:50.256052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea318cc-72df-4918-bce3-e175e6a4f403 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:50.256329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea318cc-72df-4918-bce3-e175e6a4f403 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:50.256652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea318cc-72df-4918-bce3-e175e6a4f403 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:50.267900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea318cc-72df-4918-bce3-e175e6a4f403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:50.273668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe7d8-e08f-49d8-a5f1-35b7329d9de2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-fea318cc-72df-4918-bce3-e175e6a4f403 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:50.284062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:50.285084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:16:50.286493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:50.294554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 422/842] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:50.295792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea318cc-72df-4918-bce3-e175e6a4f403 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:50.380392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffe7d8-e08f-49d8-a5f1-35b7329d9de2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:50.400383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:50.419943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ed75-a17a-45f1-b44d-09a2a21fd4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:50.421225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ed75-a17a-45f1-b44d-09a2a21fd4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:50.421723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ed75-a17a-45f1-b44d-09a2a21fd4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:50.422222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9ed75-a17a-45f1-b44d-09a2a21fd4a2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:50.422943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea318cc-72df-4918-bce3-e175e6a4f403 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:50.434784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9ed75-a17a-45f1-b44d-09a2a21fd4a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a5d9ed75-a17a-45f1-b44d-09a2a21fd4a2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:50.443515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:50.444583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:16:50.445446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:50.450722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:50.452725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 421/843] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:16:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:50.453771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ed75-a17a-45f1-b44d-09a2a21fd4a2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:50.462285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68206329-453b-4ba6-b20c-c8ec1269e7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:50.463180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68206329-453b-4ba6-b20c-c8ec1269e7e1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:50.463603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68206329-453b-4ba6-b20c-c8ec1269e7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:50.464032 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68206329-453b-4ba6-b20c-c8ec1269e7e1 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:50.464963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68206329-453b-4ba6-b20c-c8ec1269e7e1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:50.465410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68206329-453b-4ba6-b20c-c8ec1269e7e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:50.467898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68206329-453b-4ba6-b20c-c8ec1269e7e1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:50.486242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 423/844] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:16:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:50.487267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68206329-453b-4ba6-b20c-c8ec1269e7e1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:50.600547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9ed75-a17a-45f1-b44d-09a2a21fd4a2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:50.602157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68206329-453b-4ba6-b20c-c8ec1269e7e1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:50.641493 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e99f8-1d8d-4337-99af-2cdd1a662815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:50.642375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e99f8-1d8d-4337-99af-2cdd1a662815 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:50.642665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e99f8-1d8d-4337-99af-2cdd1a662815 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:50.642945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e99f8-1d8d-4337-99af-2cdd1a662815 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:50.643701 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e99f8-1d8d-4337-99af-2cdd1a662815 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:50.644016 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e99f8-1d8d-4337-99af-2cdd1a662815 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:50.645955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e99f8-1d8d-4337-99af-2cdd1a662815 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:50.648237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1559-3657-455b-98ae-c851715fd891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:50.649621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1559-3657-455b-98ae-c851715fd891 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:50.650156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1559-3657-455b-98ae-c851715fd891 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:50.650638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b1559-3657-455b-98ae-c851715fd891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:50.660257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 422/845] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:16:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:50.661417 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e99f8-1d8d-4337-99af-2cdd1a662815 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:50.664202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b1559-3657-455b-98ae-c851715fd891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:50.666998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b1559-3657-455b-98ae-c851715fd891 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-683b1559-3657-455b-98ae-c851715fd891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:50.689615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:50.690541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:50.691424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:50.691424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:50.691424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:50.691424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:50.699086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 424/846] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:50.700097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1559-3657-455b-98ae-c851715fd891 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:50.720553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:50.754834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:50.800689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e99f8-1d8d-4337-99af-2cdd1a662815 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:50.823771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b1559-3657-455b-98ae-c851715fd891 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:50.847445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097964b-39ce-4950-a2f8-cb26f7b6197a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:50.850066 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097964b-39ce-4950-a2f8-cb26f7b6197a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:50.850948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097964b-39ce-4950-a2f8-cb26f7b6197a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:50.851470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097964b-39ce-4950-a2f8-cb26f7b6197a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:50.861376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c134-f7be-4483-a2f9-8da469285f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:50.862049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c134-f7be-4483-a2f9-8da469285f90 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:50.862334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c134-f7be-4483-a2f9-8da469285f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:50.862612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c134-f7be-4483-a2f9-8da469285f90 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:50.863582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c134-f7be-4483-a2f9-8da469285f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:50.863703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c134-f7be-4483-a2f9-8da469285f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:50.865485 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261c134-f7be-4483-a2f9-8da469285f90 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:50.868877 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097964b-39ce-4950-a2f8-cb26f7b6197a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:50.870598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097964b-39ce-4950-a2f8-cb26f7b6197a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:50.883056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 425/847] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:50.884139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c134-f7be-4483-a2f9-8da469285f90 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-5097964b-39ce-4950-a2f8-cb26f7b6197a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:50.898433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:50.899332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:50.900257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:50.900257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:50.900257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:50.900257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:50.900257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 423/848] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:50.905434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097964b-39ce-4950-a2f8-cb26f7b6197a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:51.007214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:51.017491 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097964b-39ce-4950-a2f8-cb26f7b6197a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:51.021072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:51.024625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c134-f7be-4483-a2f9-8da469285f90 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:51.062020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32d4ee-913c-42ed-8e67-785ddafd21f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:51.062960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32d4ee-913c-42ed-8e67-785ddafd21f6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:51.063343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32d4ee-913c-42ed-8e67-785ddafd21f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:51.063733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32d4ee-913c-42ed-8e67-785ddafd21f6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:51.065249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a49b8-edc3-48d2-9bfc-4db9b52b24ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:51.066249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a49b8-edc3-48d2-9bfc-4db9b52b24ed None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:51.067693 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a49b8-edc3-48d2-9bfc-4db9b52b24ed None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:51.068124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8a49b8-edc3-48d2-9bfc-4db9b52b24ed None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:51.069026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a49b8-edc3-48d2-9bfc-4db9b52b24ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:51.069494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a49b8-edc3-48d2-9bfc-4db9b52b24ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:51.070997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8a49b8-edc3-48d2-9bfc-4db9b52b24ed None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:51.074209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32d4ee-913c-42ed-8e67-785ddafd21f6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:51.075625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32d4ee-913c-42ed-8e67-785ddafd21f6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:51.085892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 424/849] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:51.091235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a49b8-edc3-48d2-9bfc-4db9b52b24ed None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ef32d4ee-913c-42ed-8e67-785ddafd21f6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:51.096063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:51.097358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 25 07:16:51.098311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:51.101854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 426/850] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:16:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:51.102714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32d4ee-913c-42ed-8e67-785ddafd21f6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:51.213679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8a49b8-edc3-48d2-9bfc-4db9b52b24ed None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:51.223757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32d4ee-913c-42ed-8e67-785ddafd21f6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:51.258310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8235ba4-eb8e-4592-9a71-65438c0fb8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:51.259363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8235ba4-eb8e-4592-9a71-65438c0fb8bf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:51.259839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8235ba4-eb8e-4592-9a71-65438c0fb8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:51.260210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8235ba4-eb8e-4592-9a71-65438c0fb8bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:51.261151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d8d6b-d5e5-4b8c-a9c4-709138c40513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:51.261992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d8d6b-d5e5-4b8c-a9c4-709138c40513 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:51.262414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d8d6b-d5e5-4b8c-a9c4-709138c40513 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:51.262881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15d8d6b-d5e5-4b8c-a9c4-709138c40513 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:51.263991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d8d6b-d5e5-4b8c-a9c4-709138c40513 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:51.264448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d8d6b-d5e5-4b8c-a9c4-709138c40513 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:51.266071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15d8d6b-d5e5-4b8c-a9c4-709138c40513 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:51.269932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8235ba4-eb8e-4592-9a71-65438c0fb8bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:51.271652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8235ba4-eb8e-4592-9a71-65438c0fb8bf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c8235ba4-eb8e-4592-9a71-65438c0fb8bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:51.289260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:51.290319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:16:51.291283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:51.292542 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 427/852] 10.222.0.24 () {56 vars in 1135 bytes} [Wed May 25 07:16:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:51.293635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d8d6b-d5e5-4b8c-a9c4-709138c40513 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:51.295256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 425/852] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:16:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:51.296072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8235ba4-eb8e-4592-9a71-65438c0fb8bf None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:51.315059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:51.315400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:51.405254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15d8d6b-d5e5-4b8c-a9c4-709138c40513 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:51.428670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8235ba4-eb8e-4592-9a71-65438c0fb8bf None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:51.443977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ff327-2a10-40c1-80df-a728383a5dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:51.445303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ff327-2a10-40c1-80df-a728383a5dcb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:51.445793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ff327-2a10-40c1-80df-a728383a5dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:51.446397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43ff327-2a10-40c1-80df-a728383a5dcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:51.467371 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89123a6a-70ee-41c5-8900-55097c52f5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:51.467965 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89123a6a-70ee-41c5-8900-55097c52f5be None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:51.468244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89123a6a-70ee-41c5-8900-55097c52f5be None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:51.468533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89123a6a-70ee-41c5-8900-55097c52f5be None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:51.469667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89123a6a-70ee-41c5-8900-55097c52f5be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:51.469971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89123a6a-70ee-41c5-8900-55097c52f5be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:51.471578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89123a6a-70ee-41c5-8900-55097c52f5be None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:51.500685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 426/853] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 07:16:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:51.506721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89123a6a-70ee-41c5-8900-55097c52f5be None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:51.537257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ff327-2a10-40c1-80df-a728383a5dcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:51.538812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43ff327-2a10-40c1-80df-a728383a5dcb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:51.558257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:51.588541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:51.624343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89123a6a-70ee-41c5-8900-55097c52f5be None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:51.658571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 428/854] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:16:51.666064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ff327-2a10-40c1-80df-a728383a5dcb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:51.671639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99541d-965d-4b71-9061-8ecd0f9f0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:51.672637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99541d-965d-4b71-9061-8ecd0f9f0605 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:51.673123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99541d-965d-4b71-9061-8ecd0f9f0605 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:51.673603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de99541d-965d-4b71-9061-8ecd0f9f0605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:51.769575 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99541d-965d-4b71-9061-8ecd0f9f0605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:51.770990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de99541d-965d-4b71-9061-8ecd0f9f0605 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:51.789409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43ff327-2a10-40c1-80df-a728383a5dcb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:51.811158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:51.830123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4b2fe-3368-4443-a0ac-d0ac0f89670a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:51.831289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4b2fe-3368-4443-a0ac-d0ac0f89670a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:51.831849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4b2fe-3368-4443-a0ac-d0ac0f89670a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:51.832421 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4b2fe-3368-4443-a0ac-d0ac0f89670a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:51.844949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4b2fe-3368-4443-a0ac-d0ac0f89670a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:51.846678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4b2fe-3368-4443-a0ac-d0ac0f89670a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:51.847535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2fa4b2fe-3368-4443-a0ac-d0ac0f89670a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:51.867777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:51.869079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:51.869079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:51.869079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:51.869079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:51.875578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 429/855] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:51.876709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4b2fe-3368-4443-a0ac-d0ac0f89670a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:51.881163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 427/856] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:51 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:16:51.887854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99541d-965d-4b71-9061-8ecd0f9f0605 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.002452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4b2fe-3368-4443-a0ac-d0ac0f89670a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.013730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de99541d-965d-4b71-9061-8ecd0f9f0605 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.042737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aacc53f-01f0-4f08-9145-e05007c3a08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.043323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacc53f-01f0-4f08-9145-e05007c3a08e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.043603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacc53f-01f0-4f08-9145-e05007c3a08e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.043882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aacc53f-01f0-4f08-9145-e05007c3a08e None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.044669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacc53f-01f0-4f08-9145-e05007c3a08e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:52.044979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacc53f-01f0-4f08-9145-e05007c3a08e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.046399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aacc53f-01f0-4f08-9145-e05007c3a08e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.049945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8922b2-780d-4411-923f-e3708e58f82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.050952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8922b2-780d-4411-923f-e3708e58f82c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.051409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8922b2-780d-4411-923f-e3708e58f82c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.052389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8922b2-780d-4411-923f-e3708e58f82c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.058438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 430/857] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:52.059839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee4e8-efea-4bf9-be70-06d4455cc690 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.060131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee4e8-efea-4bf9-be70-06d4455cc690 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.060408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ee4e8-efea-4bf9-be70-06d4455cc690 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.061829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 431/858] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:52.066957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d3d8-fea2-4431-9e40-e0fa662393f4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.067318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d3d8-fea2-4431-9e40-e0fa662393f4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.068120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd7d3d8-fea2-4431-9e40-e0fa662393f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.070711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8922b2-780d-4411-923f-e3708e58f82c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.072377 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8922b2-780d-4411-923f-e3708e58f82c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.085304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fdd7d3d8-fea2-4431-9e40-e0fa662393f4 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:52.086487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fdd7d3d8-fea2-4431-9e40-e0fa662393f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-eb8922b2-780d-4411-923f-e3708e58f82c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:52.092064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:52.092995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:52.093896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:52.093896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:52.093896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:52.093896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:52.096761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 428/859] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:52.097457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8922b2-780d-4411-923f-e3708e58f82c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.115552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:52.123606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:52.161951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 432/860] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:52 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:52.162734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7d3d8-fea2-4431-9e40-e0fa662393f4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.212003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8922b2-780d-4411-923f-e3708e58f82c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.247828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eb374d-c4e6-493a-aced-a702c89cead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.248657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb374d-c4e6-493a-aced-a702c89cead2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.248940 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb374d-c4e6-493a-aced-a702c89cead2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.249211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eb374d-c4e6-493a-aced-a702c89cead2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.256027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb374d-c4e6-493a-aced-a702c89cead2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.257504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eb374d-c4e6-493a-aced-a702c89cead2 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.261780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd7d3d8-fea2-4431-9e40-e0fa662393f4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d0eb374d-c4e6-493a-aced-a702c89cead2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:52.271063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:52.271972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:52.273321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:52.273321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:52.273321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:52.273321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:52.273321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:52.273321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:52.273321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:52.273321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:52.273321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 429/861] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:52.273813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6cf1-9d86-478e-99a7-265e249b8e30 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.273813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6cf1-9d86-478e-99a7-265e249b8e30 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.274060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6cf1-9d86-478e-99a7-265e249b8e30 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.275221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 430/862] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:52.275896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf6cf1-9d86-478e-99a7-265e249b8e30 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.299824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954576a4-fd69-42aa-b271-7a58d768a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.300422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954576a4-fd69-42aa-b271-7a58d768a37a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.300733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954576a4-fd69-42aa-b271-7a58d768a37a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.301010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954576a4-fd69-42aa-b271-7a58d768a37a None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.302303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954576a4-fd69-42aa-b271-7a58d768a37a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:52.302814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954576a4-fd69-42aa-b271-7a58d768a37a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.304189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954576a4-fd69-42aa-b271-7a58d768a37a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.319901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 433/863] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:52.319901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954576a4-fd69-42aa-b271-7a58d768a37a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.338681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:52.363068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:52.382639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbf6cf1-9d86-478e-99a7-265e249b8e30 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.416846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd9c9c-7767-429a-a15c-b7e8cc462af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.417514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd9c9c-7767-429a-a15c-b7e8cc462af3 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.417800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd9c9c-7767-429a-a15c-b7e8cc462af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.418074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bd9c9c-7767-429a-a15c-b7e8cc462af3 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.418797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd9c9c-7767-429a-a15c-b7e8cc462af3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.420158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bd9c9c-7767-429a-a15c-b7e8cc462af3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.422612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954576a4-fd69-42aa-b271-7a58d768a37a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.455575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ccc97-385f-46d1-8d25-74c5b3fbfd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.456225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ccc97-385f-46d1-8d25-74c5b3fbfd81 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.456535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ccc97-385f-46d1-8d25-74c5b3fbfd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.456804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ccc97-385f-46d1-8d25-74c5b3fbfd81 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.457573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ccc97-385f-46d1-8d25-74c5b3fbfd81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:52.458178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ccc97-385f-46d1-8d25-74c5b3fbfd81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.459768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ccc97-385f-46d1-8d25-74c5b3fbfd81 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.471602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 434/864] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:52.472780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacb6ad-43a2-4a97-8814-048e86fcbb37 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.473063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacb6ad-43a2-4a97-8814-048e86fcbb37 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.473339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacb6ad-43a2-4a97-8814-048e86fcbb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.496510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 431/865] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:16:52 2022] POST /identity/v3/services => generated 251 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:52.496510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd9c9c-7767-429a-a15c-b7e8cc462af3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.496800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5aacb6ad-43a2-4a97-8814-048e86fcbb37 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:52.496800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5aacb6ad-43a2-4a97-8814-048e86fcbb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:52.582114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 435/866] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:52 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:52.583872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacb6ad-43a2-4a97-8814-048e86fcbb37 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.600422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:52.624037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bd9c9c-7767-429a-a15c-b7e8cc462af3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.661829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c2b9c-4327-43e4-918a-31957639c5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.662720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c2b9c-4327-43e4-918a-31957639c5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.663009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c2b9c-4327-43e4-918a-31957639c5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.663284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611c2b9c-4327-43e4-918a-31957639c5e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.670824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c2b9c-4327-43e4-918a-31957639c5e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.672284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611c2b9c-4327-43e4-918a-31957639c5e8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-611c2b9c-4327-43e4-918a-31957639c5e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:52.687904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:52.689105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 432/867] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:52.690028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c2b9c-4327-43e4-918a-31957639c5e8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.697471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:52.705220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacb6ad-43a2-4a97-8814-048e86fcbb37 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.745978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f82955-c596-4d0e-9af0-bfd000a4157e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.746640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f82955-c596-4d0e-9af0-bfd000a4157e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.746924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f82955-c596-4d0e-9af0-bfd000a4157e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.747197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f82955-c596-4d0e-9af0-bfd000a4157e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.748027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f82955-c596-4d0e-9af0-bfd000a4157e None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=b54767b9f07341c3aa2ba9a120a62ed0) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:52.748338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f82955-c596-4d0e-9af0-bfd000a4157e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.749847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f82955-c596-4d0e-9af0-bfd000a4157e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.757233 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 436/868] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:52 2022] GET /identity/v3/role_assignments?user.id=b54767b9f07341c3aa2ba9a120a62ed0&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=7c09d078126441909df0a46212ffea63 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:52.758024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f82955-c596-4d0e-9af0-bfd000a4157e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.836677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611c2b9c-4327-43e4-918a-31957639c5e8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.855582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:52.877759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf1e06-2846-4daa-98e9-bd54631f618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.878590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf1e06-2846-4daa-98e9-bd54631f618c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.878870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf1e06-2846-4daa-98e9-bd54631f618c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.879144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcf1e06-2846-4daa-98e9-bd54631f618c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.880178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf1e06-2846-4daa-98e9-bd54631f618c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.881700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcf1e06-2846-4daa-98e9-bd54631f618c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.893275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f82955-c596-4d0e-9af0-bfd000a4157e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8fcf1e06-2846-4daa-98e9-bd54631f618c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:52.895802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:52.896934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 433/869] 10.222.0.24 () {56 vars in 1132 bytes} [Wed May 25 07:16:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:52.903213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf1e06-2846-4daa-98e9-bd54631f618c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.936537 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405834e0-8ac0-4b31-bb40-3727f967364b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:52.937469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405834e0-8ac0-4b31-bb40-3727f967364b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:52.937903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405834e0-8ac0-4b31-bb40-3727f967364b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:52.938356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405834e0-8ac0-4b31-bb40-3727f967364b None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:52.939317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405834e0-8ac0-4b31-bb40-3727f967364b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:52.939782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405834e0-8ac0-4b31-bb40-3727f967364b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:52.941436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405834e0-8ac0-4b31-bb40-3727f967364b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:52.956118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 437/870] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:52.963579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405834e0-8ac0-4b31-bb40-3727f967364b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:52.982201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:53.024020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcf1e06-2846-4daa-98e9-bd54631f618c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:53.076335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b68946-e80a-4062-9329-f65c77de4665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:53.077316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b68946-e80a-4062-9329-f65c77de4665 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:53.077599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b68946-e80a-4062-9329-f65c77de4665 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:53.078292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b68946-e80a-4062-9329-f65c77de4665 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:53.079287 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b68946-e80a-4062-9329-f65c77de4665 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:53.079588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b68946-e80a-4062-9329-f65c77de4665 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:53.081671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b68946-e80a-4062-9329-f65c77de4665 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:53.087999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405834e0-8ac0-4b31-bb40-3727f967364b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:53.088156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 434/871] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:16:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:53.093855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b68946-e80a-4062-9329-f65c77de4665 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:53.129404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:53.137594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c95afe-5806-4cdd-9a2d-86c8193447f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:53.138892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95afe-5806-4cdd-9a2d-86c8193447f8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:53.139376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95afe-5806-4cdd-9a2d-86c8193447f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:53.139797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c95afe-5806-4cdd-9a2d-86c8193447f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:53.141180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95afe-5806-4cdd-9a2d-86c8193447f8 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=442cda3fdb25400a8cdab1655717b1e5) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:53.141652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95afe-5806-4cdd-9a2d-86c8193447f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:53.145391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c95afe-5806-4cdd-9a2d-86c8193447f8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:53.154156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 438/872] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:52 2022] GET /identity/v3/role_assignments?user.id=442cda3fdb25400a8cdab1655717b1e5&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:53.219946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b68946-e80a-4062-9329-f65c77de4665 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:53.255730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:53.262344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a4020-34dd-47d5-ad85-18e99bc8655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:53.263034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a4020-34dd-47d5-ad85-18e99bc8655f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:53.263312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a4020-34dd-47d5-ad85-18e99bc8655f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:53.263583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a4020-34dd-47d5-ad85-18e99bc8655f None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:53.264379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a4020-34dd-47d5-ad85-18e99bc8655f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:53.264763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a4020-34dd-47d5-ad85-18e99bc8655f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:53.266243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a4020-34dd-47d5-ad85-18e99bc8655f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:53.272187 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 435/873] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:16:53 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:54.746670 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fab80-e624-481c-8471-4600fdb08fde None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:54.747247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fab80-e624-481c-8471-4600fdb08fde None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:54.747247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fab80-e624-481c-8471-4600fdb08fde None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:54.748835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 439/874] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:54.754171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9317c-d955-4dd9-8f6a-b1f165e0211f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:54.754641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9317c-d955-4dd9-8f6a-b1f165e0211f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:54.754824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b9317c-d955-4dd9-8f6a-b1f165e0211f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:54.772244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a0b9317c-d955-4dd9-8f6a-b1f165e0211f None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:54.773471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a0b9317c-d955-4dd9-8f6a-b1f165e0211f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:54.848628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 436/875] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:54 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:54.870681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fab80-e624-481c-8471-4600fdb08fde None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:54.982380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fab80-e624-481c-8471-4600fdb08fde None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:55.019855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf5ae3-de0c-4f13-a8e7-ffd559bbc098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:55.021232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf5ae3-de0c-4f13-a8e7-ffd559bbc098 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.021514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf5ae3-de0c-4f13-a8e7-ffd559bbc098 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.021788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf5ae3-de0c-4f13-a8e7-ffd559bbc098 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.022443 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf5ae3-de0c-4f13-a8e7-ffd559bbc098 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:55.023825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf5ae3-de0c-4f13-a8e7-ffd559bbc098 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-2bdf5ae3-de0c-4f13-a8e7-ffd559bbc098 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:55.036639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:55.037752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:55.038683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 440/876] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:55.046090 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9317c-d955-4dd9-8f6a-b1f165e0211f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:55.147707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29236-3db2-4d7e-83b7-6358ad66e143 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.147929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29236-3db2-4d7e-83b7-6358ad66e143 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.148210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b29236-3db2-4d7e-83b7-6358ad66e143 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.149914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 441/877] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:55.150040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b9317c-d955-4dd9-8f6a-b1f165e0211f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:55.155272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927b47b-5a10-4a2e-a20b-8f9add2dfec1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.155559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927b47b-5a10-4a2e-a20b-8f9add2dfec1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.155844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927b47b-5a10-4a2e-a20b-8f9add2dfec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.173026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b927b47b-5a10-4a2e-a20b-8f9add2dfec1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:55.174222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b927b47b-5a10-4a2e-a20b-8f9add2dfec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:55.180734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:55.193615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a57ce-f1b8-4af8-ab4a-886516a93b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:55.197984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a57ce-f1b8-4af8-ab4a-886516a93b46 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.197984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a57ce-f1b8-4af8-ab4a-886516a93b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.197984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a57ce-f1b8-4af8-ab4a-886516a93b46 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.197984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a57ce-f1b8-4af8-ab4a-886516a93b46 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:55.197984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a57ce-f1b8-4af8-ab4a-886516a93b46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:55.198947 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a57ce-f1b8-4af8-ab4a-886516a93b46 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:55.205658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 437/878] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:55.211760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a57ce-f1b8-4af8-ab4a-886516a93b46 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:55.236875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:55.256609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 442/879] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:55.274696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927b47b-5a10-4a2e-a20b-8f9add2dfec1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:55.316738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a57ce-f1b8-4af8-ab4a-886516a93b46 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:55.356034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17a442-a87e-471f-be05-c838c7a18283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:55.357095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17a442-a87e-471f-be05-c838c7a18283 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.357566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17a442-a87e-471f-be05-c838c7a18283 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.358024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17a442-a87e-471f-be05-c838c7a18283 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.358930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17a442-a87e-471f-be05-c838c7a18283 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:55.359427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17a442-a87e-471f-be05-c838c7a18283 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:55.361035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17a442-a87e-471f-be05-c838c7a18283 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:55.372338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 438/880] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:55.373656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17a442-a87e-471f-be05-c838c7a18283 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:55.390365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927b47b-5a10-4a2e-a20b-8f9add2dfec1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:55.431631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c48e6-2f9a-4089-aae9-11791d673538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:55.433221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:55.433337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c48e6-2f9a-4089-aae9-11791d673538 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.434315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c48e6-2f9a-4089-aae9-11791d673538 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.434673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c48e6-2f9a-4089-aae9-11791d673538 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.435778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c48e6-2f9a-4089-aae9-11791d673538 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:55.437459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c48e6-2f9a-4089-aae9-11791d673538 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-fc4c48e6-2f9a-4089-aae9-11791d673538 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:55.455088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:55.456158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:16:55.457039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:55.461257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 443/881] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:16:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:55.465771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c48e6-2f9a-4089-aae9-11791d673538 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:55.500590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17a442-a87e-471f-be05-c838c7a18283 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:55.522439 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:55.541244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8efb54-5ea1-470c-a93f-24e8d7f7d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:55.542269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8efb54-5ea1-470c-a93f-24e8d7f7d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.542760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8efb54-5ea1-470c-a93f-24e8d7f7d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.543256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8efb54-5ea1-470c-a93f-24e8d7f7d0c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.544269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8efb54-5ea1-470c-a93f-24e8d7f7d0c4 None admin] RBAC: Adding query filter params (interface=public, service_id=aeec176d8ea04ea6bd04050ac4ebdd5f, region_id=RegionOne) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:55.544807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8efb54-5ea1-470c-a93f-24e8d7f7d0c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:55.546465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8efb54-5ea1-470c-a93f-24e8d7f7d0c4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:55.556311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 439/882] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 07:16:55 2022] GET /identity/v3/endpoints?service_id=aeec176d8ea04ea6bd04050ac4ebdd5f&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:55.557558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c17cf5-3832-44b5-97bb-f6be50791324 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.557864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c17cf5-3832-44b5-97bb-f6be50791324 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.558150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c17cf5-3832-44b5-97bb-f6be50791324 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.559558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 440/883] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:55.561673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c17cf5-3832-44b5-97bb-f6be50791324 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:55.579179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c48e6-2f9a-4089-aae9-11791d673538 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:55.615941 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7b6620-bcb3-438f-a2fe-2e3442d0edd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:55.616986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b6620-bcb3-438f-a2fe-2e3442d0edd3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.617414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b6620-bcb3-438f-a2fe-2e3442d0edd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.617689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b6620-bcb3-438f-a2fe-2e3442d0edd3 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.618385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b6620-bcb3-438f-a2fe-2e3442d0edd3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:55.618690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b6620-bcb3-438f-a2fe-2e3442d0edd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:55.620055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7b6620-bcb3-438f-a2fe-2e3442d0edd3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:55.629186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 444/884] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:16:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:55.629186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad092c0-968e-4b7c-965f-7c8918d5843d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.629186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad092c0-968e-4b7c-965f-7c8918d5843d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.629186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad092c0-968e-4b7c-965f-7c8918d5843d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.642454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cad092c0-968e-4b7c-965f-7c8918d5843d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:55.643617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cad092c0-968e-4b7c-965f-7c8918d5843d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:55.675038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c17cf5-3832-44b5-97bb-f6be50791324 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:55.691888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:55.709706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961ff891-bc6e-4bbb-8dbd-de12ea09875a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:55.710368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ff891-bc6e-4bbb-8dbd-de12ea09875a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.710650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ff891-bc6e-4bbb-8dbd-de12ea09875a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.710927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961ff891-bc6e-4bbb-8dbd-de12ea09875a None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.711613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ff891-bc6e-4bbb-8dbd-de12ea09875a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:55.713026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961ff891-bc6e-4bbb-8dbd-de12ea09875a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:55.713492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 445/885] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:55.714806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc703f6-148c-4ba5-a06e-2d1366aec606 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.715090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc703f6-148c-4ba5-a06e-2d1366aec606 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.715407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc703f6-148c-4ba5-a06e-2d1366aec606 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.721308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 446/886] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:55.721308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc703f6-148c-4ba5-a06e-2d1366aec606 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:55.721533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 441/887] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 07:16:55 2022] GET /identity/v3/services => generated 1011 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:16:55.722634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a335-a18b-419f-8da3-5782da2d9e80 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.723721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a335-a18b-419f-8da3-5782da2d9e80 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.724584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a335-a18b-419f-8da3-5782da2d9e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.746521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-edb1a335-a18b-419f-8da3-5782da2d9e80 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:55.747766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-edb1a335-a18b-419f-8da3-5782da2d9e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:55.792350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:55.827226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 442/888] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:55 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:55.828098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1a335-a18b-419f-8da3-5782da2d9e80 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:55.869101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc703f6-148c-4ba5-a06e-2d1366aec606 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:55.912948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedb8da-b885-4f44-a0c2-f021702680c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:55.913617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedb8da-b885-4f44-a0c2-f021702680c4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.913897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedb8da-b885-4f44-a0c2-f021702680c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.914172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cedb8da-b885-4f44-a0c2-f021702680c4 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:55.914881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedb8da-b885-4f44-a0c2-f021702680c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:55.915226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedb8da-b885-4f44-a0c2-f021702680c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:55.917045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cedb8da-b885-4f44-a0c2-f021702680c4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:55.928503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 447/889] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:16:55 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:55.928503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedb8da-b885-4f44-a0c2-f021702680c4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:55.949936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1a335-a18b-419f-8da3-5782da2d9e80 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:55.964844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:55.991720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a0b0-7504-4adc-a953-4096f89d76d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:55.992829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a0b0-7504-4adc-a953-4096f89d76d2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:55.993181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a0b0-7504-4adc-a953-4096f89d76d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:55.993539 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796a0b0-7504-4adc-a953-4096f89d76d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:56.006558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796a0b0-7504-4adc-a953-4096f89d76d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-3796a0b0-7504-4adc-a953-4096f89d76d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:16:56.015543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:56.016602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:56.017483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 443/890] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 07:16:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:56.023698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a0b0-7504-4adc-a953-4096f89d76d2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:56.057724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cedb8da-b885-4f44-a0c2-f021702680c4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:56.070060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:56.095363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8c097-16f9-4892-a5be-be3c5c2f2339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:56.096161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8c097-16f9-4892-a5be-be3c5c2f2339 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:56.096581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8c097-16f9-4892-a5be-be3c5c2f2339 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:56.096927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d8c097-16f9-4892-a5be-be3c5c2f2339 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:56.097777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8c097-16f9-4892-a5be-be3c5c2f2339 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:56.100104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d8c097-16f9-4892-a5be-be3c5c2f2339 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:56.150708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796a0b0-7504-4adc-a953-4096f89d76d2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:56.183588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 448/891] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:16:55 2022] POST /identity/v3/services => generated 269 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:56.206125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca74d9-cde6-4001-8e70-d66d781beeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:56.207165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca74d9-cde6-4001-8e70-d66d781beeee None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:56.207979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca74d9-cde6-4001-8e70-d66d781beeee None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:56.208611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca74d9-cde6-4001-8e70-d66d781beeee None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:56.209626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca74d9-cde6-4001-8e70-d66d781beeee None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:56.210139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca74d9-cde6-4001-8e70-d66d781beeee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:56.211767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca74d9-cde6-4001-8e70-d66d781beeee None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:56.222921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 444/892] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 07:16:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:56.229091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8c097-16f9-4892-a5be-be3c5c2f2339 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:56.343767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d8c097-16f9-4892-a5be-be3c5c2f2339 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:56.381538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d339bad-14ae-449f-8221-b857833d6394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:56.383008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339bad-14ae-449f-8221-b857833d6394 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:56.383490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339bad-14ae-449f-8221-b857833d6394 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:56.384029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d339bad-14ae-449f-8221-b857833d6394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:56.396419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d339bad-14ae-449f-8221-b857833d6394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:56.398487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d339bad-14ae-449f-8221-b857833d6394 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-1d339bad-14ae-449f-8221-b857833d6394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:56.419198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:56.420162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:56.421115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:56.421115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:56.421115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:56.421115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:56.421852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 449/893] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:56.429631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca74d9-cde6-4001-8e70-d66d781beeee None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:56.463696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:56.539766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca74d9-cde6-4001-8e70-d66d781beeee None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:56.575635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfe533-eb09-4258-a883-1b496323cb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:56.576350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfe533-eb09-4258-a883-1b496323cb89 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:56.576677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfe533-eb09-4258-a883-1b496323cb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:56.576957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dfe533-eb09-4258-a883-1b496323cb89 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:56.577742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfe533-eb09-4258-a883-1b496323cb89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:56.578055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfe533-eb09-4258-a883-1b496323cb89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:56.579424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dfe533-eb09-4258-a883-1b496323cb89 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:56.593415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 445/894] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:56.598577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d339bad-14ae-449f-8221-b857833d6394 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:56.625994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:56.709529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d339bad-14ae-449f-8221-b857833d6394 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:56.745030 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3765-541a-41fe-a045-97aa5e1cbfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:56.746141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3765-541a-41fe-a045-97aa5e1cbfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:56.746608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3765-541a-41fe-a045-97aa5e1cbfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:56.747060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed3765-541a-41fe-a045-97aa5e1cbfe0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:56.755239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed3765-541a-41fe-a045-97aa5e1cbfe0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:56.757077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed3765-541a-41fe-a045-97aa5e1cbfe0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-40ed3765-541a-41fe-a045-97aa5e1cbfe0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:16:56.774579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:56.775595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:16:56.776609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:56.778917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 450/895] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:16:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:56.788520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfe533-eb09-4258-a883-1b496323cb89 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:56.876673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:56.889748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dfe533-eb09-4258-a883-1b496323cb89 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:56.926067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ac60-70f5-433a-ba29-72c6866ef8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:56.926825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ac60-70f5-433a-ba29-72c6866ef8ad None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:56.927111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ac60-70f5-433a-ba29-72c6866ef8ad None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:56.927389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ac60-70f5-433a-ba29-72c6866ef8ad None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:56.928271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285ac60-70f5-433a-ba29-72c6866ef8ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:56.928615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285ac60-70f5-433a-ba29-72c6866ef8ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:56.930219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285ac60-70f5-433a-ba29-72c6866ef8ad None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:56.949951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 446/896] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 07:16:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:56.955454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3765-541a-41fe-a045-97aa5e1cbfe0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:57.046041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:57.063979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed3765-541a-41fe-a045-97aa5e1cbfe0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:57.100746 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7a509-107a-42d3-9152-ccbcc4976cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:57.101424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7a509-107a-42d3-9152-ccbcc4976cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:57.101709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7a509-107a-42d3-9152-ccbcc4976cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:57.101988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7a509-107a-42d3-9152-ccbcc4976cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:57.173767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7a509-107a-42d3-9152-ccbcc4976cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:57.175246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7a509-107a-42d3-9152-ccbcc4976cc8 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:57.257411 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:57.276676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 451/897] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:16:56 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:16:57.281994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ac60-70f5-433a-ba29-72c6866ef8ad None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:57.389660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ac60-70f5-433a-ba29-72c6866ef8ad None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:57.424404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189544b4-2ded-44f8-9d83-7edfab8721fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:57.425231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189544b4-2ded-44f8-9d83-7edfab8721fa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:57.425514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189544b4-2ded-44f8-9d83-7edfab8721fa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:57.425787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189544b4-2ded-44f8-9d83-7edfab8721fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:57.436691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189544b4-2ded-44f8-9d83-7edfab8721fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:57.438141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189544b4-2ded-44f8-9d83-7edfab8721fa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:57.445308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-189544b4-2ded-44f8-9d83-7edfab8721fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:16:57.456540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:57.457682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:57.459123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:16:57.459123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:16:57.459123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:16:57.459123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:57.459123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 447/898] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:57.464119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7a509-107a-42d3-9152-ccbcc4976cc8 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:57.568999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7a509-107a-42d3-9152-ccbcc4976cc8 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:57.605394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afae5b0-9308-40f3-a747-422cc594b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:57.606064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afae5b0-9308-40f3-a747-422cc594b68a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:57.606346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afae5b0-9308-40f3-a747-422cc594b68a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:57.606623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afae5b0-9308-40f3-a747-422cc594b68a None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:57.607351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afae5b0-9308-40f3-a747-422cc594b68a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:57.607654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afae5b0-9308-40f3-a747-422cc594b68a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:57.609059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afae5b0-9308-40f3-a747-422cc594b68a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:57.622115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 452/899] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:57.627263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189544b4-2ded-44f8-9d83-7edfab8721fa None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:57.731874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189544b4-2ded-44f8-9d83-7edfab8721fa None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:57.767360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828c0ba-a3e4-44c6-b395-bfce26052c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:57.768166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828c0ba-a3e4-44c6-b395-bfce26052c0e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:57.768450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828c0ba-a3e4-44c6-b395-bfce26052c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:57.768753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7828c0ba-a3e4-44c6-b395-bfce26052c0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:57.776317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828c0ba-a3e4-44c6-b395-bfce26052c0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:57.777825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7828c0ba-a3e4-44c6-b395-bfce26052c0e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7828c0ba-a3e4-44c6-b395-bfce26052c0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:16:57.792660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:57.793645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:57.795639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:16:57.795639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:16:57.795639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:16:57.795639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:16:57.795639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:16:57.795639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:16:57.795639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:16:57.795639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:57.795639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 448/900] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:57.799764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afae5b0-9308-40f3-a747-422cc594b68a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:57.850021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:57.916327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afae5b0-9308-40f3-a747-422cc594b68a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:57.955271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160af02c-082c-4c7c-96e8-a329f98d6e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:57.955935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af02c-082c-4c7c-96e8-a329f98d6e6e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:57.956558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af02c-082c-4c7c-96e8-a329f98d6e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:57.956558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160af02c-082c-4c7c-96e8-a329f98d6e6e None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:57.957277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160af02c-082c-4c7c-96e8-a329f98d6e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:57.958120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160af02c-082c-4c7c-96e8-a329f98d6e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:57.959653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160af02c-082c-4c7c-96e8-a329f98d6e6e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:57.972796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 453/901] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:57.978894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828c0ba-a3e4-44c6-b395-bfce26052c0e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:58.040449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:58.086137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7828c0ba-a3e4-44c6-b395-bfce26052c0e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:58.110623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23381ff-0882-4621-96d4-cad97e3143b3 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.110951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23381ff-0882-4621-96d4-cad97e3143b3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.111179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23381ff-0882-4621-96d4-cad97e3143b3 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.112801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 454/902] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:58.117812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13cb8f-ecb4-4cc3-9d95-6ddb882c4b8c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.118095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13cb8f-ecb4-4cc3-9d95-6ddb882c4b8c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.118373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c13cb8f-ecb4-4cc3-9d95-6ddb882c4b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.125207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7cc23-e94d-4a39-86ca-7ce4dd25c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:58.125873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7cc23-e94d-4a39-86ca-7ce4dd25c6bb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.126154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7cc23-e94d-4a39-86ca-7ce4dd25c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.126435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7cc23-e94d-4a39-86ca-7ce4dd25c6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.127274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7cc23-e94d-4a39-86ca-7ce4dd25c6bb None admin] RBAC: Adding query filter params (role.id=04321844426a44e5b76b8c33ef3363a2, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=442cda3fdb25400a8cdab1655717b1e5) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:58.127588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7cc23-e94d-4a39-86ca-7ce4dd25c6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:58.129069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7cc23-e94d-4a39-86ca-7ce4dd25c6bb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:58.135475 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1c13cb8f-ecb4-4cc3-9d95-6ddb882c4b8c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:58.135784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 449/903] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:16:57 2022] GET /identity/v3/role_assignments?user.id=442cda3fdb25400a8cdab1655717b1e5&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=04321844426a44e5b76b8c33ef3363a2 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:58.136828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1c13cb8f-ecb4-4cc3-9d95-6ddb882c4b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:58.215750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 455/904] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:58.240381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7cc23-e94d-4a39-86ca-7ce4dd25c6bb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:58.287955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f3df-4bf1-4406-a732-6b9335e83f4c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.287955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f3df-4bf1-4406-a732-6b9335e83f4c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.287955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445f3df-4bf1-4406-a732-6b9335e83f4c None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.288839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 456/905] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:58.294891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc79d61-76d8-42bc-99a0-4d982dc6fc5c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.295511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc79d61-76d8-42bc-99a0-4d982dc6fc5c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.296011 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc79d61-76d8-42bc-99a0-4d982dc6fc5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.321167 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4cc79d61-76d8-42bc-99a0-4d982dc6fc5c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:58.322536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4cc79d61-76d8-42bc-99a0-4d982dc6fc5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:58.354738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:58.367803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7cc23-e94d-4a39-86ca-7ce4dd25c6bb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:58.392044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:58.407029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa2a8-3e2a-42e4-8849-117579144d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:58.407413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 457/906] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:16:58.408025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa2a8-3e2a-42e4-8849-117579144d1b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.408377 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa2a8-3e2a-42e4-8849-117579144d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.408804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fa2a8-3e2a-42e4-8849-117579144d1b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.409561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fa2a8-3e2a-42e4-8849-117579144d1b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:58.411846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fa2a8-3e2a-42e4-8849-117579144d1b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e88fa2a8-3e2a-42e4-8849-117579144d1b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:58.425650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:58.427430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:16:58.429244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 450/907] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:16:58.431320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc79d61-76d8-42bc-99a0-4d982dc6fc5c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:58.434674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa2a8-3e2a-42e4-8849-117579144d1b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:58.552896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fa2a8-3e2a-42e4-8849-117579144d1b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:58.565152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc79d61-76d8-42bc-99a0-4d982dc6fc5c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:58.596108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45116a-b2b4-4069-bdc0-e34433872571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:58.596808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45116a-b2b4-4069-bdc0-e34433872571 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.597090 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45116a-b2b4-4069-bdc0-e34433872571 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.597364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45116a-b2b4-4069-bdc0-e34433872571 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.598085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45116a-b2b4-4069-bdc0-e34433872571 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:58.599124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45116a-b2b4-4069-bdc0-e34433872571 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:58.601219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45116a-b2b4-4069-bdc0-e34433872571 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:58.606946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 451/908] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:58.608555 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b4c8-30ca-48f4-8e85-a99fbab7292e None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.609058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b4c8-30ca-48f4-8e85-a99fbab7292e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.609340 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5b4c8-30ca-48f4-8e85-a99fbab7292e None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.610698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 452/909] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:16:58.613542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5b4c8-30ca-48f4-8e85-a99fbab7292e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:58.619990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15939d5b-3af9-4644-afc7-b7042e664d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:58.620891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15939d5b-3af9-4644-afc7-b7042e664d20 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.621171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15939d5b-3af9-4644-afc7-b7042e664d20 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.621440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15939d5b-3af9-4644-afc7-b7042e664d20 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.622152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15939d5b-3af9-4644-afc7-b7042e664d20 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:58.623534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15939d5b-3af9-4644-afc7-b7042e664d20 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:58.666545 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:58.696947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 458/910] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:16:58 2022] POST /identity/v3/services => generated 241 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:16:58.698622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d524-fb61-46b5-bfb6-5064d1b575a7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.698917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d524-fb61-46b5-bfb6-5064d1b575a7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.699190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735d524-fb61-46b5-bfb6-5064d1b575a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.732026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f735d524-fb61-46b5-bfb6-5064d1b575a7 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:16:58.733413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5b4c8-30ca-48f4-8e85-a99fbab7292e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:58.733637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f735d524-fb61-46b5-bfb6-5064d1b575a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:16:58.755462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:58.776687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca0e7b-7e15-47b2-ad42-d379b1ad7034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:58.777727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca0e7b-7e15-47b2-ad42-d379b1ad7034 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.778148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca0e7b-7e15-47b2-ad42-d379b1ad7034 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.778590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca0e7b-7e15-47b2-ad42-d379b1ad7034 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.779516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca0e7b-7e15-47b2-ad42-d379b1ad7034 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:58.779990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca0e7b-7e15-47b2-ad42-d379b1ad7034 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:58.781598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eca0e7b-7e15-47b2-ad42-d379b1ad7034 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:58.789504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 453/911] 10.222.0.24 () {56 vars in 1114 bytes} [Wed May 25 07:16:58 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:58.794968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca0e7b-7e15-47b2-ad42-d379b1ad7034 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:58.825544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 459/912] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:16:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:16:58.848975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735d524-fb61-46b5-bfb6-5064d1b575a7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:58.931834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca0e7b-7e15-47b2-ad42-d379b1ad7034 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:58.944839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:58.962727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735d524-fb61-46b5-bfb6-5064d1b575a7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:58.981998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397144-69be-4db1-a108-cac3fdf17747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:58.982668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397144-69be-4db1-a108-cac3fdf17747 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:58.982956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397144-69be-4db1-a108-cac3fdf17747 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:58.983236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2397144-69be-4db1-a108-cac3fdf17747 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:58.984002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2397144-69be-4db1-a108-cac3fdf17747 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:58.986226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2397144-69be-4db1-a108-cac3fdf17747 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:58.999384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194cec08-c948-4fd2-93e3-42c7f41ea6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:59.000210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cec08-c948-4fd2-93e3-42c7f41ea6c4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:59.000512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cec08-c948-4fd2-93e3-42c7f41ea6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:59.000789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194cec08-c948-4fd2-93e3-42c7f41ea6c4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:59.001445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194cec08-c948-4fd2-93e3-42c7f41ea6c4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:59.002828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194cec08-c948-4fd2-93e3-42c7f41ea6c4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-194cec08-c948-4fd2-93e3-42c7f41ea6c4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:16:59.016344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:16:59.017393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:16:59.018248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 460/913] 10.222.0.24 () {56 vars in 1132 bytes} [Wed May 25 07:16:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:16:59.024462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194cec08-c948-4fd2-93e3-42c7f41ea6c4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:59.047930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:59.076846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 454/914] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 07:16:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:16:59.154068 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194cec08-c948-4fd2-93e3-42c7f41ea6c4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:59.201135 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec1fc-4fec-43b1-bc68-386f2707bc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:59.201820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec1fc-4fec-43b1-bc68-386f2707bc79 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:59.202104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec1fc-4fec-43b1-bc68-386f2707bc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:59.202381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7ec1fc-4fec-43b1-bc68-386f2707bc79 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:59.203212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec1fc-4fec-43b1-bc68-386f2707bc79 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:59.203529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec1fc-4fec-43b1-bc68-386f2707bc79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:59.205022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7ec1fc-4fec-43b1-bc68-386f2707bc79 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:59.212355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 461/915] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:16:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:16:59.218652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397144-69be-4db1-a108-cac3fdf17747 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:59.332882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2397144-69be-4db1-a108-cac3fdf17747 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:59.369892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3b5ea-15af-43a7-9358-8e4a5bdd9d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:59.370921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3b5ea-15af-43a7-9358-8e4a5bdd9d74 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:59.371435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3b5ea-15af-43a7-9358-8e4a5bdd9d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:59.371912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3b5ea-15af-43a7-9358-8e4a5bdd9d74 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:59.372869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3b5ea-15af-43a7-9358-8e4a5bdd9d74 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:59.373393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3b5ea-15af-43a7-9358-8e4a5bdd9d74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:59.374963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3b5ea-15af-43a7-9358-8e4a5bdd9d74 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:59.384647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 455/916] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:16:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:59.387678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec1fc-4fec-43b1-bc68-386f2707bc79 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:59.470940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:59.495716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7ec1fc-4fec-43b1-bc68-386f2707bc79 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:59.533048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa3964-463f-4b53-a9f3-ee1499f4c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:59.534069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa3964-463f-4b53-a9f3-ee1499f4c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:59.534499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa3964-463f-4b53-a9f3-ee1499f4c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:59.534924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa3964-463f-4b53-a9f3-ee1499f4c6f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:59.535970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa3964-463f-4b53-a9f3-ee1499f4c6f9 None admin] RBAC: Adding query filter params (interface=public, service_id=4e9430323133447e870a756fc2b5206e, region_id=RegionOne) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:16:59.536435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa3964-463f-4b53-a9f3-ee1499f4c6f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:59.537987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fa3964-463f-4b53-a9f3-ee1499f4c6f9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:59.543906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 462/917] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 07:16:59 2022] GET /identity/v3/endpoints?service_id=4e9430323133447e870a756fc2b5206e&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:16:59.549627 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3b5ea-15af-43a7-9358-8e4a5bdd9d74 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:16:59.590459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:16:59.664323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3b5ea-15af-43a7-9358-8e4a5bdd9d74 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:16:59.699842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90f7ae4-eace-4a10-af90-a145ab3960fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:16:59.700528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f7ae4-eace-4a10-af90-a145ab3960fc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:16:59.700820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f7ae4-eace-4a10-af90-a145ab3960fc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:16:59.701102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90f7ae4-eace-4a10-af90-a145ab3960fc None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:16:59.701791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f7ae4-eace-4a10-af90-a145ab3960fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:16:59.703170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90f7ae4-eace-4a10-af90-a145ab3960fc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:16:59.716885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 456/918] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 07:16:59 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:17:00.465965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b771-e317-4648-a87c-7cf1f9592b59 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:00.467260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b771-e317-4648-a87c-7cf1f9592b59 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:00.467750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4b771-e317-4648-a87c-7cf1f9592b59 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:00.469609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 463/919] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:00.475513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4abf7-d111-4e6b-9c94-7327b8ab286d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:00.476353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4abf7-d111-4e6b-9c94-7327b8ab286d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:00.476864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4abf7-d111-4e6b-9c94-7327b8ab286d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:00.494310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0df4abf7-d111-4e6b-9c94-7327b8ab286d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:00.495865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0df4abf7-d111-4e6b-9c94-7327b8ab286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:00.566400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 457/920] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:00.590007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b771-e317-4648-a87c-7cf1f9592b59 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:00.699019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4b771-e317-4648-a87c-7cf1f9592b59 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:00.734950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186fe91-ad3e-4780-b725-b8c424a89dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:00.735694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186fe91-ad3e-4780-b725-b8c424a89dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:00.735976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186fe91-ad3e-4780-b725-b8c424a89dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:00.736252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7186fe91-ad3e-4780-b725-b8c424a89dd7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:00.745157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:00.749289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7186fe91-ad3e-4780-b725-b8c424a89dd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-7186fe91-ad3e-4780-b725-b8c424a89dd7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:00.758007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:00.763168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:00.764712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 464/921] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 07:17:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:00.765632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4abf7-d111-4e6b-9c94-7327b8ab286d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:00.795614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:00.878953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df4abf7-d111-4e6b-9c94-7327b8ab286d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:00.918930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8e6ad-d013-4076-8b40-45c7faf5e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:00.919981 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e6ad-d013-4076-8b40-45c7faf5e29c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:00.920522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e6ad-d013-4076-8b40-45c7faf5e29c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:00.921003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8e6ad-d013-4076-8b40-45c7faf5e29c None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:00.922047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e6ad-d013-4076-8b40-45c7faf5e29c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:00.922561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e6ad-d013-4076-8b40-45c7faf5e29c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:00.924139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8e6ad-d013-4076-8b40-45c7faf5e29c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:00.934248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 458/922] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 07:17:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:00.939623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186fe91-ad3e-4780-b725-b8c424a89dd7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:00.979350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe22ab8-bff2-43db-aa66-a31d99d31a96 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:00.979718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe22ab8-bff2-43db-aa66-a31d99d31a96 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:00.979908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe22ab8-bff2-43db-aa66-a31d99d31a96 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:00.981576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 459/923] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:00.986743 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de614-5b1e-4545-a179-ccfc733a4728 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:00.986957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de614-5b1e-4545-a179-ccfc733a4728 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:00.987237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de614-5b1e-4545-a179-ccfc733a4728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.008446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2f5de614-5b1e-4545-a179-ccfc733a4728 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:01.010140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2f5de614-5b1e-4545-a179-ccfc733a4728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:01.056283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7186fe91-ad3e-4780-b725-b8c424a89dd7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:01.101437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e40ad-ccfa-49b5-9f40-9fd0556e09b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:01.102085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 460/924] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:00 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:01.102974 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e40ad-ccfa-49b5-9f40-9fd0556e09b4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.103262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e40ad-ccfa-49b5-9f40-9fd0556e09b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.103537 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176e40ad-ccfa-49b5-9f40-9fd0556e09b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.114982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e40ad-ccfa-49b5-9f40-9fd0556e09b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:01.116445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176e40ad-ccfa-49b5-9f40-9fd0556e09b4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:01.124624 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de614-5b1e-4545-a179-ccfc733a4728 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-176e40ad-ccfa-49b5-9f40-9fd0556e09b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:01.135161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:01.136108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:01.137056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:01.137056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:01.137056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:01.137056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:01.137056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 465/925] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:01.141877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e40ad-ccfa-49b5-9f40-9fd0556e09b4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:01.149182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:01.209053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:01.268051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de614-5b1e-4545-a179-ccfc733a4728 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:01.272978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176e40ad-ccfa-49b5-9f40-9fd0556e09b4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:01.309083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083ba17-5e23-482a-ae1b-339495a3b222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:01.310060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083ba17-5e23-482a-ae1b-339495a3b222 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.310349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083ba17-5e23-482a-ae1b-339495a3b222 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.310622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9083ba17-5e23-482a-ae1b-339495a3b222 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.311573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083ba17-5e23-482a-ae1b-339495a3b222 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:01.312856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9083ba17-5e23-482a-ae1b-339495a3b222 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:01.321517 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da33950-2c91-48b7-a623-ce63f0b2f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:01.322426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da33950-2c91-48b7-a623-ce63f0b2f299 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.322850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da33950-2c91-48b7-a623-ce63f0b2f299 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.323290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da33950-2c91-48b7-a623-ce63f0b2f299 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.324156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da33950-2c91-48b7-a623-ce63f0b2f299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:01.324633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da33950-2c91-48b7-a623-ce63f0b2f299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:01.326149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da33950-2c91-48b7-a623-ce63f0b2f299 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-9083ba17-5e23-482a-ae1b-339495a3b222 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:01.326423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:01.327600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:01.328547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.332854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 461/926] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:17:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:01.334045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083ba17-5e23-482a-ae1b-339495a3b222 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:01.345002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 466/927] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:01.352118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da33950-2c91-48b7-a623-ce63f0b2f299 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:01.438247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:01.459375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9083ba17-5e23-482a-ae1b-339495a3b222 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:01.471609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da33950-2c91-48b7-a623-ce63f0b2f299 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:01.487235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:01.504316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7791ced-4d90-4dbf-8035-b8528468ad9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:01.505554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7791ced-4d90-4dbf-8035-b8528468ad9a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.505824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7791ced-4d90-4dbf-8035-b8528468ad9a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.506102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7791ced-4d90-4dbf-8035-b8528468ad9a None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.506891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7791ced-4d90-4dbf-8035-b8528468ad9a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:01.507222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7791ced-4d90-4dbf-8035-b8528468ad9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:01.508608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7791ced-4d90-4dbf-8035-b8528468ad9a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:01.512128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0fc3-17e9-4cd3-ab7b-3bd198bf845b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:01.513338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0fc3-17e9-4cd3-ab7b-3bd198bf845b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.513467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 462/928] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:17:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:01.513921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0fc3-17e9-4cd3-ab7b-3bd198bf845b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.514430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0fc3-17e9-4cd3-ab7b-3bd198bf845b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.514569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75098b93-b861-49e4-85d5-61dc1b4e31d1 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.514843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75098b93-b861-49e4-85d5-61dc1b4e31d1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.515114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75098b93-b861-49e4-85d5-61dc1b4e31d1 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.516499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 463/929] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:01.519016 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75098b93-b861-49e4-85d5-61dc1b4e31d1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:01.529475 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec0fc3-17e9-4cd3-ab7b-3bd198bf845b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:01.530943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec0fc3-17e9-4cd3-ab7b-3bd198bf845b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-0dec0fc3-17e9-4cd3-ab7b-3bd198bf845b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:17:01.546561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:01.547698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 467/930] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:17:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a305-6825-4f04-ab49-2533c924cf0a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.554225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a305-6825-4f04-ab49-2533c924cf0a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.554958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a305-6825-4f04-ab49-2533c924cf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.568431 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a432a305-6825-4f04-ab49-2533c924cf0a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:01.569628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a432a305-6825-4f04-ab49-2533c924cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:01.642696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 468/931] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:01 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:01.646128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432a305-6825-4f04-ab49-2533c924cf0a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:01.647886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75098b93-b861-49e4-85d5-61dc1b4e31d1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:01.686057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892131fd-f005-474a-bae2-72f4a709fa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:01.686731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892131fd-f005-474a-bae2-72f4a709fa95 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.686998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892131fd-f005-474a-bae2-72f4a709fa95 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.687272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892131fd-f005-474a-bae2-72f4a709fa95 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.688046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892131fd-f005-474a-bae2-72f4a709fa95 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:01.688350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892131fd-f005-474a-bae2-72f4a709fa95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:01.689752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892131fd-f005-474a-bae2-72f4a709fa95 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:01.695952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 464/932] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:17:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:01.696556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892131fd-f005-474a-bae2-72f4a709fa95 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:01.707486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:01.765706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432a305-6825-4f04-ab49-2533c924cf0a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:01.767316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:01.801838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf16fb5-1d76-43b4-9bf6-a317b705b503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:01.802694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf16fb5-1d76-43b4-9bf6-a317b705b503 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.802979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf16fb5-1d76-43b4-9bf6-a317b705b503 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.803258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf16fb5-1d76-43b4-9bf6-a317b705b503 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.804093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf16fb5-1d76-43b4-9bf6-a317b705b503 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:01.804409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf16fb5-1d76-43b4-9bf6-a317b705b503 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:01.805945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf16fb5-1d76-43b4-9bf6-a317b705b503 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:01.810266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892131fd-f005-474a-bae2-72f4a709fa95 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:01.825242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 469/933] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 07:17:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:01.825943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf16fb5-1d76-43b4-9bf6-a317b705b503 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:01.851710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:01.852561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.852672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.852956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.853664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:01.855097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:01.856465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING keystone.server.flask.common [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 07:17:01.921546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.sql.core [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 07:17:01.921546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 07:17:01.921546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [parameters: {'id': 'fdb718042f1a42d3a5e853b2e82715ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 07:17:01.921546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80335) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fdb718042f1a42d3a5e853b2e82715ea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fdb718042f1a42d3a5e853b2e82715ea. May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application conn.query(q) May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:17:01.933507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result.read() May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 07:17:01.940355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application next(self.gen) May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application yield resource May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application next(self.gen) May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.session.rollback() May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.force_reraise() May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise self.value May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application session.commit() May 25 07:17:01.941642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._prepare_impl() May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.session.flush() May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._flush(objects) May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application compat.raise_( May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application flush_context.execute() May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 07:17:01.943658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rec.execute(self) May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 07:17:01.944892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application conn.query(q) May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result.read() May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:17:01.945893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [parameters: {'id': 'fdb718042f1a42d3a5e853b2e82715ea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:01.947070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:01.948067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:01.949385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:01.949385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 07:17:01.949385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 07:17:01.949385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:01.949385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:01.949385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 07:17:01.949385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 07:17:01.949385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fdb718042f1a42d3a5e853b2e82715ea. May 25 07:17:01.949385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:01.949994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf16fb5-1d76-43b4-9bf6-a317b705b503 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:01.950089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 465/934] 10.222.0.24 () {60 vars in 1140 bytes} [Wed May 25 07:17:01 2022] POST /identity/v3/projects => generated 262 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:01.950089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:01.986590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91443451-2e39-4822-afb3-e0e10c9d3863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:01.987496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91443451-2e39-4822-afb3-e0e10c9d3863 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:01.987941 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91443451-2e39-4822-afb3-e0e10c9d3863 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:01.988362 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91443451-2e39-4822-afb3-e0e10c9d3863 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:01.989705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91443451-2e39-4822-afb3-e0e10c9d3863 None admin] RBAC: Adding query filter params (interface=public, service_id=630b4b01345d4d51871df110d9869583, region_id=RegionOne) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:01.990200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91443451-2e39-4822-afb3-e0e10c9d3863 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:01.991741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91443451-2e39-4822-afb3-e0e10c9d3863 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:01.997013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 470/935] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 07:17:01 2022] GET /identity/v3/endpoints?service_id=630b4b01345d4d51871df110d9869583&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:01.997827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91443451-2e39-4822-afb3-e0e10c9d3863 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.010671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:02.028157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:02.050517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fece290-c440-46e8-9d9f-2d5bb15d4eb7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.085971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8bca-50f3-4d85-86a8-7d1f3660c89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:02.086689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8bca-50f3-4d85-86a8-7d1f3660c89e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.086967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8bca-50f3-4d85-86a8-7d1f3660c89e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.087241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d8bca-50f3-4d85-86a8-7d1f3660c89e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.097870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8bca-50f3-4d85-86a8-7d1f3660c89e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:02.099780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d8bca-50f3-4d85-86a8-7d1f3660c89e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:02.106776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91443451-2e39-4822-afb3-e0e10c9d3863 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-bb3d8bca-50f3-4d85-86a8-7d1f3660c89e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:02.116068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:02.117281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:02.118612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:02.118612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:02.118612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:02.118612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:02.118612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 466/936] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:02.118612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8bca-50f3-4d85-86a8-7d1f3660c89e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.143483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee5a55-c0c7-4cda-8e30-5b68633e2080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:02.144280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5a55-c0c7-4cda-8e30-5b68633e2080 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.144594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5a55-c0c7-4cda-8e30-5b68633e2080 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.144884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee5a55-c0c7-4cda-8e30-5b68633e2080 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.152615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee5a55-c0c7-4cda-8e30-5b68633e2080 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:02.154081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ee5a55-c0c7-4cda-8e30-5b68633e2080 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-90ee5a55-c0c7-4cda-8e30-5b68633e2080 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:17:02.168055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:02.169017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:02.169917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:17:02.169917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:17:02.169917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:17:02.169917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:17:02.169917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:17:02.169917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:17:02.169917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:02.169917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:02.169917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 471/937] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:17:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:02.170800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8164e7-de91-4773-9cd2-b41d41f5c655 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.170800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8164e7-de91-4773-9cd2-b41d41f5c655 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.171093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8164e7-de91-4773-9cd2-b41d41f5c655 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.172354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 472/938] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:02.173072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8164e7-de91-4773-9cd2-b41d41f5c655 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.223076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d8bca-50f3-4d85-86a8-7d1f3660c89e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.238694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:02.256640 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b627d-95d4-4a72-959a-5d09ca4cb496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:02.257136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:02.257345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b627d-95d4-4a72-959a-5d09ca4cb496 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.257628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b627d-95d4-4a72-959a-5d09ca4cb496 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.257911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8b627d-95d4-4a72-959a-5d09ca4cb496 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.258660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b627d-95d4-4a72-959a-5d09ca4cb496 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:02.260022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8b627d-95d4-4a72-959a-5d09ca4cb496 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:02.268856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 467/939] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 07:17:02 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:17:02.269646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b627d-95d4-4a72-959a-5d09ca4cb496 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.274447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8164e7-de91-4773-9cd2-b41d41f5c655 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.312373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e16be4-fa7c-4e5f-a05c-819df701a857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:02.313190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e16be4-fa7c-4e5f-a05c-819df701a857 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.313486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e16be4-fa7c-4e5f-a05c-819df701a857 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.313765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e16be4-fa7c-4e5f-a05c-819df701a857 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.314556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e16be4-fa7c-4e5f-a05c-819df701a857 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:02.314873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e16be4-fa7c-4e5f-a05c-819df701a857 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:02.316282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e16be4-fa7c-4e5f-a05c-819df701a857 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:02.330012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 473/940] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:02.331391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e6060-8d19-4afb-8eb3-91623e29658b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.331677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e6060-8d19-4afb-8eb3-91623e29658b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.332010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e6060-8d19-4afb-8eb3-91623e29658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.351968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-444e6060-8d19-4afb-8eb3-91623e29658b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:02.353123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-444e6060-8d19-4afb-8eb3-91623e29658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:02.394663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8b627d-95d4-4a72-959a-5d09ca4cb496 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.440506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 474/941] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:02 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:02.440506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e6060-8d19-4afb-8eb3-91623e29658b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.441902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fb9b2-8602-4b02-b775-1d9a4eca00f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:02.443385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fb9b2-8602-4b02-b775-1d9a4eca00f7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.443767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fb9b2-8602-4b02-b775-1d9a4eca00f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.444115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fb9b2-8602-4b02-b775-1d9a4eca00f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.445011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fb9b2-8602-4b02-b775-1d9a4eca00f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:02.445389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fb9b2-8602-4b02-b775-1d9a4eca00f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:02.446970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fb9b2-8602-4b02-b775-1d9a4eca00f7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:02.467710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 468/942] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:17:02 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:02.468739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fb9b2-8602-4b02-b775-1d9a4eca00f7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.526872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:02.535218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:02.564550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e6060-8d19-4afb-8eb3-91623e29658b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.593036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fb9b2-8602-4b02-b775-1d9a4eca00f7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.610799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7a99-25b9-457b-ab4b-29c2f4339813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:02.611646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7a99-25b9-457b-ab4b-29c2f4339813 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.611936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7a99-25b9-457b-ab4b-29c2f4339813 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.612213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee7a99-25b9-457b-ab4b-29c2f4339813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.621725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee7a99-25b9-457b-ab4b-29c2f4339813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:02.623522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ee7a99-25b9-457b-ab4b-29c2f4339813 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:02.631589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ebd27-f604-4499-96e6-6d85aaec8ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:02.632418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ebd27-f604-4499-96e6-6d85aaec8ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.632727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ebd27-f604-4499-96e6-6d85aaec8ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.633001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ebd27-f604-4499-96e6-6d85aaec8ae4 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.633669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ebd27-f604-4499-96e6-6d85aaec8ae4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:02.635052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97ebd27-f604-4499-96e6-6d85aaec8ae4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-81ee7a99-25b9-457b-ab4b-29c2f4339813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:17:02.640218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:02.642226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:02.644455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:17:02.644455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:17:02.644455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:17:02.644455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:17:02.644455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:17:02.644455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:17:02.644455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:02.644455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:02.644455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 475/943] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:02.650645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7a99-25b9-457b-ab4b-29c2f4339813 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a97ebd27-f604-4499-96e6-6d85aaec8ae4 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:02.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:02.652133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:02.653872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 469/944] 10.222.0.24 () {56 vars in 1132 bytes} [Wed May 25 07:17:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:02.661635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ebd27-f604-4499-96e6-6d85aaec8ae4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.781142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee7a99-25b9-457b-ab4b-29c2f4339813 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.789438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97ebd27-f604-4499-96e6-6d85aaec8ae4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.794730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:02.827094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790e3e3-b131-4947-ba5e-5e9019956a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:02.827762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e3e3-b131-4947-ba5e-5e9019956a47 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.828136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e3e3-b131-4947-ba5e-5e9019956a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.828672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7790e3e3-b131-4947-ba5e-5e9019956a47 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.829764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e3e3-b131-4947-ba5e-5e9019956a47 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:02.829963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0e371-3a77-482d-9f5e-6828c77ac7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:02.830269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e3e3-b131-4947-ba5e-5e9019956a47 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:02.830825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0e371-3a77-482d-9f5e-6828c77ac7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:02.831415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0e371-3a77-482d-9f5e-6828c77ac7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:02.831758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c0e371-3a77-482d-9f5e-6828c77ac7d4 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:02.832045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7790e3e3-b131-4947-ba5e-5e9019956a47 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:02.833235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0e371-3a77-482d-9f5e-6828c77ac7d4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:02.833672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0e371-3a77-482d-9f5e-6828c77ac7d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:02.834512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:02.835208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c0e371-3a77-482d-9f5e-6828c77ac7d4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:02.840754 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 470/945] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:17:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:02.846273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0e371-3a77-482d-9f5e-6828c77ac7d4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.849153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 476/946] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:02.855025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790e3e3-b131-4947-ba5e-5e9019956a47 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:02.965714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7790e3e3-b131-4947-ba5e-5e9019956a47 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:02.968143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c0e371-3a77-482d-9f5e-6828c77ac7d4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:03.002686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a7189b-8949-46f0-aadd-66d340d4b612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:03.003611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7189b-8949-46f0-aadd-66d340d4b612 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:03.003888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7189b-8949-46f0-aadd-66d340d4b612 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:03.004162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a7189b-8949-46f0-aadd-66d340d4b612 None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/442cda3fdb25400a8cdab1655717b1e5/roles/04321844426a44e5b76b8c33ef3363a2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:03.006127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f0720-e024-4e8f-949d-3cec0c442a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:03.006598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7189b-8949-46f0-aadd-66d340d4b612 None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=442cda3fdb25400a8cdab1655717b1e5, role_id=04321844426a44e5b76b8c33ef3363a2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:03.006987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f0720-e024-4e8f-949d-3cec0c442a83 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:03.007365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f0720-e024-4e8f-949d-3cec0c442a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:03.007748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f0720-e024-4e8f-949d-3cec0c442a83 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:03.008038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a7189b-8949-46f0-aadd-66d340d4b612 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:03.008706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f0720-e024-4e8f-949d-3cec0c442a83 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:03.009112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f0720-e024-4e8f-949d-3cec0c442a83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:03.010566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336f0720-e024-4e8f-949d-3cec0c442a83 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:03.015915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 471/947] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:17:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:03.021743 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f0720-e024-4e8f-949d-3cec0c442a83 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:03.055761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:03.097876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 477/948] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:17:02 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/442cda3fdb25400a8cdab1655717b1e5/roles/04321844426a44e5b76b8c33ef3363a2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:17:03.147811 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f0720-e024-4e8f-949d-3cec0c442a83 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:03.189457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e087d-f969-4ca7-9f01-49d169ed397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:03.190136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e087d-f969-4ca7-9f01-49d169ed397a None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:03.190413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e087d-f969-4ca7-9f01-49d169ed397a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:03.190687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e087d-f969-4ca7-9f01-49d169ed397a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:03.191446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e087d-f969-4ca7-9f01-49d169ed397a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:03.193402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e087d-f969-4ca7-9f01-49d169ed397a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:03.315117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 472/949] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 07:17:03 2022] POST /identity/v3/endpoints => generated 347 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:17:04.609118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5e7fe-409c-454f-9d29-9d89008a6072 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:04.609604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5e7fe-409c-454f-9d29-9d89008a6072 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:04.609682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5e7fe-409c-454f-9d29-9d89008a6072 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:04.611197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 478/950] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:04.617380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ca38e-ba3b-451e-8be5-460d2b3fd441 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:04.618186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ca38e-ba3b-451e-8be5-460d2b3fd441 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:04.618670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76ca38e-ba3b-451e-8be5-460d2b3fd441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:04.636773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d76ca38e-ba3b-451e-8be5-460d2b3fd441 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:04.638628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d76ca38e-ba3b-451e-8be5-460d2b3fd441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:04.724601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 473/951] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:04.743831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5e7fe-409c-454f-9d29-9d89008a6072 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:04.804536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:04.852677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03f627-99c0-4cbf-8039-4dd212b4ba10 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:04.852974 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5e7fe-409c-454f-9d29-9d89008a6072 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:04.853486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03f627-99c0-4cbf-8039-4dd212b4ba10 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:04.853964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03f627-99c0-4cbf-8039-4dd212b4ba10 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:04.856849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 474/952] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:04.866464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af5e5-0bad-48e8-9fd8-be1ea304f303 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:04.867013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af5e5-0bad-48e8-9fd8-be1ea304f303 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:04.867512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535af5e5-0bad-48e8-9fd8-be1ea304f303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:04.888771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-535af5e5-0bad-48e8-9fd8-be1ea304f303 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:04.890703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-535af5e5-0bad-48e8-9fd8-be1ea304f303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:04.891589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739f8e-3440-4f28-b41f-2f805d8c5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:04.892410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739f8e-3440-4f28-b41f-2f805d8c5f10 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:04.892714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739f8e-3440-4f28-b41f-2f805d8c5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:04.892986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2739f8e-3440-4f28-b41f-2f805d8c5f10 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:04.893643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739f8e-3440-4f28-b41f-2f805d8c5f10 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:04.895533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2739f8e-3440-4f28-b41f-2f805d8c5f10 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:04.904100 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-d2739f8e-3440-4f28-b41f-2f805d8c5f10 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:04.907891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:04.909041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:04.916463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 479/953] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:17:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:04.918451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739f8e-3440-4f28-b41f-2f805d8c5f10 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:05.000843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 475/954] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:04 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:05.022470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af5e5-0bad-48e8-9fd8-be1ea304f303 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:05.037474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2739f8e-3440-4f28-b41f-2f805d8c5f10 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:05.058508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:05.078538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c39a39-229f-4bb2-b004-59256c7c1069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:05.079215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c39a39-229f-4bb2-b004-59256c7c1069 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.079506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c39a39-229f-4bb2-b004-59256c7c1069 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.079796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c39a39-229f-4bb2-b004-59256c7c1069 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.080534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c39a39-229f-4bb2-b004-59256c7c1069 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:05.080852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c39a39-229f-4bb2-b004-59256c7c1069 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:05.082235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c39a39-229f-4bb2-b004-59256c7c1069 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:05.093340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 480/955] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:17:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:05.094945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c39a39-229f-4bb2-b004-59256c7c1069 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:05.163390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535af5e5-0bad-48e8-9fd8-be1ea304f303 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:05.207305 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c39a39-229f-4bb2-b004-59256c7c1069 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:05.216453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:05.217671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.218944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.219237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.219989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:05.222050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:05.249789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff476683-bf99-4925-b60a-ad34804ceabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:05.250853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff476683-bf99-4925-b60a-ad34804ceabf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.251338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff476683-bf99-4925-b60a-ad34804ceabf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.251903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff476683-bf99-4925-b60a-ad34804ceabf None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.252884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff476683-bf99-4925-b60a-ad34804ceabf None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:05.253395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff476683-bf99-4925-b60a-ad34804ceabf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:05.255885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff476683-bf99-4925-b60a-ad34804ceabf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:05.266366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 481/956] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:17:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:05.267999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff476683-bf99-4925-b60a-ad34804ceabf None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:05.320275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:05.353544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.sql.core [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 07:17:05.353544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 07:17:05.353544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [parameters: {'user_id': '1c310fecaac245c492f1d606711d4c49', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 07:17:05.353544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80335) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application conn.query(q) May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result.read() May 25 07:17:05.363395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:17:05.364865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application next(self.gen) May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application yield resource May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application next(self.gen) May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.session.rollback() May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.force_reraise() May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise self.value May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application session.commit() May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 07:17:05.366039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._prepare_impl() May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.session.flush() May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._flush(objects) May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application compat.raise_( May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application flush_context.execute() May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rec.execute(self) May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 07:17:05.366952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:17:05.367840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application conn.query(q) May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application result.read() May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:17:05.370224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [parameters: {'user_id': '1c310fecaac245c492f1d606711d4c49', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:05.372248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 07:17:05.374597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 07:17:05.378844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 07:17:05.378844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 07:17:05.378844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 07:17:05.378844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 07:17:05.378844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 07:17:05.378844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:05.386402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 476/957] 10.222.0.24 () {60 vars in 1131 bytes} [Wed May 25 07:17:05 2022] POST /identity/v3/users => generated 160 bytes in 363 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:05.387821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:05.388056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff476683-bf99-4925-b60a-ad34804ceabf None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:05.398534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:05.428769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b1587-28ec-4a30-a1f8-737621cb9e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:05.429355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1587-28ec-4a30-a1f8-737621cb9e53 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.429634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1587-28ec-4a30-a1f8-737621cb9e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.429906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b1587-28ec-4a30-a1f8-737621cb9e53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.430646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1587-28ec-4a30-a1f8-737621cb9e53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:05.432023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b1587-28ec-4a30-a1f8-737621cb9e53 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:05.497083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef5c09-caac-48b2-834d-6ed03cbdb05d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:05.530736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814389e-215a-4064-8cc1-e2e605d392e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:05.531558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814389e-215a-4064-8cc1-e2e605d392e0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.531841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814389e-215a-4064-8cc1-e2e605d392e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.532122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814389e-215a-4064-8cc1-e2e605d392e0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.548502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 482/958] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 07:17:05 2022] POST /identity/v3/endpoints => generated 349 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:17:05.548502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618780e-c38e-4826-921b-d00b0165085b None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.548502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618780e-c38e-4826-921b-d00b0165085b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.548502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618780e-c38e-4826-921b-d00b0165085b None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.548502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 483/959] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:05.548968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20399e93-e634-4f8a-94e7-5da9acd0d108 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.549418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20399e93-e634-4f8a-94e7-5da9acd0d108 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.549747 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20399e93-e634-4f8a-94e7-5da9acd0d108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.551960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814389e-215a-4064-8cc1-e2e605d392e0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:05.554017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814389e-215a-4064-8cc1-e2e605d392e0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:05.569366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-20399e93-e634-4f8a-94e7-5da9acd0d108 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:05.570711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-20399e93-e634-4f8a-94e7-5da9acd0d108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7814389e-215a-4064-8cc1-e2e605d392e0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:17:05.571420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:05.572320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:05.573317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 477/960] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:17:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:05.580892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814389e-215a-4064-8cc1-e2e605d392e0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:05.668301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:05.685000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 484/961] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:05.686340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff869b-70b6-493a-80ec-86c838c003cd None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.686629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff869b-70b6-493a-80ec-86c838c003cd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.686902 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff869b-70b6-493a-80ec-86c838c003cd None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.688348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 485/962] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:05.694705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6cfd6-49a8-4035-8ed4-81f9963abf95 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.694992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6cfd6-49a8-4035-8ed4-81f9963abf95 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.695252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6cfd6-49a8-4035-8ed4-81f9963abf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.714733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1eb6cfd6-49a8-4035-8ed4-81f9963abf95 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:05.715987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1eb6cfd6-49a8-4035-8ed4-81f9963abf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:05.732518 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814389e-215a-4064-8cc1-e2e605d392e0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:05.742373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:05.773312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc94b4-53c7-401c-8462-136ee706bb19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:05.773992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc94b4-53c7-401c-8462-136ee706bb19 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.780567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc94b4-53c7-401c-8462-136ee706bb19 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.780567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cc94b4-53c7-401c-8462-136ee706bb19 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.780567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc94b4-53c7-401c-8462-136ee706bb19 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:05.780567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc94b4-53c7-401c-8462-136ee706bb19 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:05.780567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cc94b4-53c7-401c-8462-136ee706bb19 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:05.788767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 486/963] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:05.789656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6cfd6-49a8-4035-8ed4-81f9963abf95 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:05.819437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 478/964] 10.222.0.24 () {56 vars in 1101 bytes} [Wed May 25 07:17:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:05.820783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc94b4-53c7-401c-8462-136ee706bb19 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:05.908657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6cfd6-49a8-4035-8ed4-81f9963abf95 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:05.963557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b77d15-2731-44d8-b039-635218a6b57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:05.964562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b77d15-2731-44d8-b039-635218a6b57c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:05.964855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b77d15-2731-44d8-b039-635218a6b57c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:05.965157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b77d15-2731-44d8-b039-635218a6b57c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:05.965623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cc94b4-53c7-401c-8462-136ee706bb19 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:05.979332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b77d15-2731-44d8-b039-635218a6b57c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-74b77d15-2731-44d8-b039-635218a6b57c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:05.990391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:05.991424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:05.992298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:05.996634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 487/965] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 07:17:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:05.998361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b77d15-2731-44d8-b039-635218a6b57c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:05.999079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:06.014189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6a902-724d-4420-9caf-221016234224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:06.015624 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6a902-724d-4420-9caf-221016234224 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:06.016062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6a902-724d-4420-9caf-221016234224 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:06.016528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6a902-724d-4420-9caf-221016234224 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:06.017517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6a902-724d-4420-9caf-221016234224 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:06.019705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d6a902-724d-4420-9caf-221016234224 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:06.025367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c7d6a902-724d-4420-9caf-221016234224 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:06.036447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:06.041441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:06.042303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 479/966] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:17:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:06.044416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6a902-724d-4420-9caf-221016234224 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:06.129072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b77d15-2731-44d8-b039-635218a6b57c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:06.172442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d6a902-724d-4420-9caf-221016234224 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:06.172775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a45b1-ddf9-460d-ba4c-ba189bd04d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:06.173435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a45b1-ddf9-460d-ba4c-ba189bd04d21 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:06.173720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a45b1-ddf9-460d-ba4c-ba189bd04d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:06.173992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3a45b1-ddf9-460d-ba4c-ba189bd04d21 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:06.174771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a45b1-ddf9-460d-ba4c-ba189bd04d21 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:06.175080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a45b1-ddf9-460d-ba4c-ba189bd04d21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:06.177394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3a45b1-ddf9-460d-ba4c-ba189bd04d21 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:06.186606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 488/967] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 07:17:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:06.192405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a45b1-ddf9-460d-ba4c-ba189bd04d21 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:06.210048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dc1c5-51dd-437e-b8db-8c722a881c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:06.210718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dc1c5-51dd-437e-b8db-8c722a881c04 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:06.211004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dc1c5-51dd-437e-b8db-8c722a881c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:06.211284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9dc1c5-51dd-437e-b8db-8c722a881c04 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:06.211999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dc1c5-51dd-437e-b8db-8c722a881c04 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:06.212314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dc1c5-51dd-437e-b8db-8c722a881c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:06.219086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9dc1c5-51dd-437e-b8db-8c722a881c04 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:06.219219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 480/968] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:17:06 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:06.225668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dc1c5-51dd-437e-b8db-8c722a881c04 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:06.281591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:06.288868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:06.309019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3a45b1-ddf9-460d-ba4c-ba189bd04d21 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:06.330715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9dc1c5-51dd-437e-b8db-8c722a881c04 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:06.346625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd83f6-2f44-4e1c-8fab-b8a9fb41cc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:06.347523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd83f6-2f44-4e1c-8fab-b8a9fb41cc51 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:06.348264 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd83f6-2f44-4e1c-8fab-b8a9fb41cc51 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:06.348844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd83f6-2f44-4e1c-8fab-b8a9fb41cc51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:06.360832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd83f6-2f44-4e1c-8fab-b8a9fb41cc51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:06.362406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cd83f6-2f44-4e1c-8fab-b8a9fb41cc51 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:06.366460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b030-d322-4353-9cb5-2fa88353913e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:06.367129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b030-d322-4353-9cb5-2fa88353913e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:06.367414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b030-d322-4353-9cb5-2fa88353913e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:06.367689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a1b030-d322-4353-9cb5-2fa88353913e None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:06.368397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b030-d322-4353-9cb5-2fa88353913e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:06.368766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b030-d322-4353-9cb5-2fa88353913e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:06.370125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a1b030-d322-4353-9cb5-2fa88353913e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:06.384508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 481/969] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:17:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a1cd83f6-2f44-4e1c-8fab-b8a9fb41cc51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:06.384711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:06.385766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:06.386888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:06.386888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:06.386888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:06.386888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:06.386888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 489/970] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:06.388229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b030-d322-4353-9cb5-2fa88353913e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:06.501581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a1b030-d322-4353-9cb5-2fa88353913e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:06.520899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:06.539867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6939-c86c-4093-a6da-e6dbe75a81a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:06.540745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6939-c86c-4093-a6da-e6dbe75a81a8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:06.541095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6939-c86c-4093-a6da-e6dbe75a81a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:06.541439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac6939-c86c-4093-a6da-e6dbe75a81a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:06.542256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6939-c86c-4093-a6da-e6dbe75a81a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:06.542629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6939-c86c-4093-a6da-e6dbe75a81a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:06.544094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac6939-c86c-4093-a6da-e6dbe75a81a8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:06.560526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 482/971] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:06.563334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd83f6-2f44-4e1c-8fab-b8a9fb41cc51 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:06.669085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd83f6-2f44-4e1c-8fab-b8a9fb41cc51 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:06.697796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:06.703462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979ec9e-b3a0-4b4a-9b4f-8e886f02053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:06.704254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979ec9e-b3a0-4b4a-9b4f-8e886f02053b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:06.704554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979ec9e-b3a0-4b4a-9b4f-8e886f02053b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:06.704823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979ec9e-b3a0-4b4a-9b4f-8e886f02053b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:06.712560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979ec9e-b3a0-4b4a-9b4f-8e886f02053b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:06.714192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979ec9e-b3a0-4b4a-9b4f-8e886f02053b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-0979ec9e-b3a0-4b4a-9b4f-8e886f02053b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:17:06.730165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:06.731151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:06.736798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 490/972] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:17:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:06.738410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6939-c86c-4093-a6da-e6dbe75a81a8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:06.841159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac6939-c86c-4093-a6da-e6dbe75a81a8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:06.875531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a144e-ac08-47ed-b9d2-d6976b75a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:06.876197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a144e-ac08-47ed-b9d2-d6976b75a7ca None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:06.876486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a144e-ac08-47ed-b9d2-d6976b75a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:06.876765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a144e-ac08-47ed-b9d2-d6976b75a7ca None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:06.877604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a144e-ac08-47ed-b9d2-d6976b75a7ca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:06.877910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a144e-ac08-47ed-b9d2-d6976b75a7ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:06.879368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856a144e-ac08-47ed-b9d2-d6976b75a7ca None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:06.900858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 483/973] 10.222.0.24 () {56 vars in 1149 bytes} [Wed May 25 07:17:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:06.903277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979ec9e-b3a0-4b4a-9b4f-8e886f02053b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:07.004899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979ec9e-b3a0-4b4a-9b4f-8e886f02053b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:07.038896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10185044-351c-4308-8f61-f3dfa0ad6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:07.039546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10185044-351c-4308-8f61-f3dfa0ad6509 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:07.039824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10185044-351c-4308-8f61-f3dfa0ad6509 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:07.040095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10185044-351c-4308-8f61-f3dfa0ad6509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:07.099796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:07.109613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10185044-351c-4308-8f61-f3dfa0ad6509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:07.111112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10185044-351c-4308-8f61-f3dfa0ad6509 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:07.215675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 491/974] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:06 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:17:07.217369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a144e-ac08-47ed-b9d2-d6976b75a7ca None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:07.255004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:07.321064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a144e-ac08-47ed-b9d2-d6976b75a7ca None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:07.355119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab5d07-91ea-4e32-9bea-11c0a5c28005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:07.355830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab5d07-91ea-4e32-9bea-11c0a5c28005 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:07.356108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab5d07-91ea-4e32-9bea-11c0a5c28005 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:07.356379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ab5d07-91ea-4e32-9bea-11c0a5c28005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:07.367777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab5d07-91ea-4e32-9bea-11c0a5c28005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:07.369252 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ab5d07-91ea-4e32-9bea-11c0a5c28005 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-d8ab5d07-91ea-4e32-9bea-11c0a5c28005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:07.387216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:07.388132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:07.389435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:07.389435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:07.389435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:07.389435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:07.392792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 484/975] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:07.394042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10185044-351c-4308-8f61-f3dfa0ad6509 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:07.489283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:07.499266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10185044-351c-4308-8f61-f3dfa0ad6509 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:07.535933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc91b1-21a7-4ef6-a0a7-433ddfdd160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:07.536798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc91b1-21a7-4ef6-a0a7-433ddfdd160a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:07.537083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc91b1-21a7-4ef6-a0a7-433ddfdd160a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:07.537357 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc91b1-21a7-4ef6-a0a7-433ddfdd160a None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:07.538091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc91b1-21a7-4ef6-a0a7-433ddfdd160a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:07.538400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc91b1-21a7-4ef6-a0a7-433ddfdd160a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:07.539775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bc91b1-21a7-4ef6-a0a7-433ddfdd160a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:07.552748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 492/976] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:07.558465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab5d07-91ea-4e32-9bea-11c0a5c28005 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:07.656591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:07.671471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ab5d07-91ea-4e32-9bea-11c0a5c28005 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:07.704617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf3d0a-36ce-4416-bbc8-d13d68ac7f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:07.705414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf3d0a-36ce-4416-bbc8-d13d68ac7f5e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:07.705694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf3d0a-36ce-4416-bbc8-d13d68ac7f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:07.705961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdf3d0a-36ce-4416-bbc8-d13d68ac7f5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:07.714101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf3d0a-36ce-4416-bbc8-d13d68ac7f5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:07.715711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdf3d0a-36ce-4416-bbc8-d13d68ac7f5e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7cdf3d0a-36ce-4416-bbc8-d13d68ac7f5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:17:07.731649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:07.732989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:07.733891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:17:07.733891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:17:07.733891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:17:07.733891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:17:07.733891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:17:07.733891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:17:07.733891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:07.733891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:07.737033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 485/977] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:07.739664 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc91b1-21a7-4ef6-a0a7-433ddfdd160a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:07.842554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bc91b1-21a7-4ef6-a0a7-433ddfdd160a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:07.875515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d992cd1a-7953-40c7-aca7-c4d42114cac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:07.876169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cd1a-7953-40c7-aca7-c4d42114cac5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:07.876448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cd1a-7953-40c7-aca7-c4d42114cac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:07.876747 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d992cd1a-7953-40c7-aca7-c4d42114cac5 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:07.877529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992cd1a-7953-40c7-aca7-c4d42114cac5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:07.877833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992cd1a-7953-40c7-aca7-c4d42114cac5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:07.879437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d992cd1a-7953-40c7-aca7-c4d42114cac5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:07.896849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 493/978] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:07.898058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf3d0a-36ce-4416-bbc8-d13d68ac7f5e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:07.915076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497e43-a7a8-4de1-9e3c-a5923c97eb6c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:07.915593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497e43-a7a8-4de1-9e3c-a5923c97eb6c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:07.915962 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f497e43-a7a8-4de1-9e3c-a5923c97eb6c None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:07.917483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 494/979] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:07.922779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe8f05-0ab1-4e04-9d56-b9a808a28279 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:07.923073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe8f05-0ab1-4e04-9d56-b9a808a28279 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:07.923350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe8f05-0ab1-4e04-9d56-b9a808a28279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:07.940943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6cbe8f05-0ab1-4e04-9d56-b9a808a28279 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:07.942960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6cbe8f05-0ab1-4e04-9d56-b9a808a28279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:07.950917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:08.010374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdf3d0a-36ce-4416-bbc8-d13d68ac7f5e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:08.013190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 495/980] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:08.036194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe8f05-0ab1-4e04-9d56-b9a808a28279 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:08.045142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680451c6-7379-41c4-98a5-01e2b434f83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:08.045796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680451c6-7379-41c4-98a5-01e2b434f83c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:08.046078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680451c6-7379-41c4-98a5-01e2b434f83c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:08.046352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680451c6-7379-41c4-98a5-01e2b434f83c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:08.047182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680451c6-7379-41c4-98a5-01e2b434f83c None admin] RBAC: Adding query filter params (role.id=04321844426a44e5b76b8c33ef3363a2, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=442cda3fdb25400a8cdab1655717b1e5) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:08.047490 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680451c6-7379-41c4-98a5-01e2b434f83c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:08.048948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680451c6-7379-41c4-98a5-01e2b434f83c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:08.064503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 486/981] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:17:07 2022] GET /identity/v3/role_assignments?user.id=442cda3fdb25400a8cdab1655717b1e5&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=04321844426a44e5b76b8c33ef3363a2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:08.149116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe8f05-0ab1-4e04-9d56-b9a808a28279 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:08.185152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c551fe-5481-4319-8a50-3c8c90a490f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:08.185891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c551fe-5481-4319-8a50-3c8c90a490f3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:08.186166 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c551fe-5481-4319-8a50-3c8c90a490f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:08.186434 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c551fe-5481-4319-8a50-3c8c90a490f3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:08.187092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c551fe-5481-4319-8a50-3c8c90a490f3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:08.188499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c551fe-5481-4319-8a50-3c8c90a490f3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c1c551fe-5481-4319-8a50-3c8c90a490f3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:08.202172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:08.203259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:08.204108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 496/982] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:17:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:08.210405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680451c6-7379-41c4-98a5-01e2b434f83c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:08.226474 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:08.323960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680451c6-7379-41c4-98a5-01e2b434f83c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:08.357925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece5337-67c6-4145-9121-279f4b440376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:08.358584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece5337-67c6-4145-9121-279f4b440376 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:08.358868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece5337-67c6-4145-9121-279f4b440376 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:08.359138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece5337-67c6-4145-9121-279f4b440376 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:08.359842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece5337-67c6-4145-9121-279f4b440376 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:08.360143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece5337-67c6-4145-9121-279f4b440376 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:08.361557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece5337-67c6-4145-9121-279f4b440376 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:08.366452 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 487/983] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:17:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:08.372303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c551fe-5481-4319-8a50-3c8c90a490f3 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:08.381593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:08.477441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c551fe-5481-4319-8a50-3c8c90a490f3 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:08.511447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ffd89-d2b6-422e-9f96-e26c55c02809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:08.512111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ffd89-d2b6-422e-9f96-e26c55c02809 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:08.512388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ffd89-d2b6-422e-9f96-e26c55c02809 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:08.512681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ffd89-d2b6-422e-9f96-e26c55c02809 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:08.513382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ffd89-d2b6-422e-9f96-e26c55c02809 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:08.513683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ffd89-d2b6-422e-9f96-e26c55c02809 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:08.515037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85ffd89-d2b6-422e-9f96-e26c55c02809 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:08.520016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 497/984] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:17:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:08.525493 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece5337-67c6-4145-9121-279f4b440376 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:08.607141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e1e45-1eda-4d20-9506-aac1f70c337d None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:08.607475 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e1e45-1eda-4d20-9506-aac1f70c337d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:08.607759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652e1e45-1eda-4d20-9506-aac1f70c337d None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:08.609470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 498/985] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:08.610776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:08.615222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27eadd1-c708-4cac-9c89-a41f4f781c77 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:08.615515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27eadd1-c708-4cac-9c89-a41f4f781c77 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:08.615794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27eadd1-c708-4cac-9c89-a41f4f781c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:08.635933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e27eadd1-c708-4cac-9c89-a41f4f781c77 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:08.637156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e27eadd1-c708-4cac-9c89-a41f4f781c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:08.637263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece5337-67c6-4145-9121-279f4b440376 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:08.673590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1872069-ef37-4227-9d56-3f07f1aa6e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:08.674241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872069-ef37-4227-9d56-3f07f1aa6e84 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:08.674519 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872069-ef37-4227-9d56-3f07f1aa6e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:08.674789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1872069-ef37-4227-9d56-3f07f1aa6e84 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:08.675588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1872069-ef37-4227-9d56-3f07f1aa6e84 None admin] RBAC: Adding query filter params (interface=admin, service_id=630b4b01345d4d51871df110d9869583, region_id=RegionOne) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:08.676658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1872069-ef37-4227-9d56-3f07f1aa6e84 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:08.677825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1872069-ef37-4227-9d56-3f07f1aa6e84 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:08.684311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 488/986] 10.222.0.24 () {56 vars in 1249 bytes} [Wed May 25 07:17:08 2022] GET /identity/v3/endpoints?service_id=630b4b01345d4d51871df110d9869583&interface=admin®ion_id=RegionOne => generated 193 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:08.689681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1872069-ef37-4227-9d56-3f07f1aa6e84 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:08.704178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:08.716903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 499/987] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:08.731912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27eadd1-c708-4cac-9c89-a41f4f781c77 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:08.800370 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1872069-ef37-4227-9d56-3f07f1aa6e84 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:08.837485 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27eadd1-c708-4cac-9c89-a41f4f781c77 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:08.842384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e56b7-2239-4541-ac82-13040f875d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:08.843055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e56b7-2239-4541-ac82-13040f875d2c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:08.843334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e56b7-2239-4541-ac82-13040f875d2c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:08.843604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e56b7-2239-4541-ac82-13040f875d2c None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:08.844289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e56b7-2239-4541-ac82-13040f875d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:08.846215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774e56b7-2239-4541-ac82-13040f875d2c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:08.861909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 489/988] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 07:17:08 2022] GET /identity/v3/services => generated 1497 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:17:08.874600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2240c1a4-bd02-419c-93c0-fa2ec239c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:08.875291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240c1a4-bd02-419c-93c0-fa2ec239c157 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:08.875573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240c1a4-bd02-419c-93c0-fa2ec239c157 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:08.875842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2240c1a4-bd02-419c-93c0-fa2ec239c157 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:08.876612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240c1a4-bd02-419c-93c0-fa2ec239c157 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:08.878047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2240c1a4-bd02-419c-93c0-fa2ec239c157 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:08.976526 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 500/989] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:17:08 2022] POST /identity/v3/services => generated 242 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:17:10.326558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8da367-69f6-4a06-828c-e00815f5dba7 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:10.327116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8da367-69f6-4a06-828c-e00815f5dba7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:10.327116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8da367-69f6-4a06-828c-e00815f5dba7 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:10.328656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 490/990] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:10.333708 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f16d1c-1a5a-4b08-bc4f-8067f5cdc9eb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:10.334112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f16d1c-1a5a-4b08-bc4f-8067f5cdc9eb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:10.334291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f16d1c-1a5a-4b08-bc4f-8067f5cdc9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:10.351629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e9f16d1c-1a5a-4b08-bc4f-8067f5cdc9eb None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:10.352906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e9f16d1c-1a5a-4b08-bc4f-8067f5cdc9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:10.409328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:10.427756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 501/991] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:10.449684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8da367-69f6-4a06-828c-e00815f5dba7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:10.452556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:10.553688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8da367-69f6-4a06-828c-e00815f5dba7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:10.595316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe66e3-a3b1-4887-be53-2006dbbb30b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:10.595941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe66e3-a3b1-4887-be53-2006dbbb30b5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:10.596218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe66e3-a3b1-4887-be53-2006dbbb30b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:10.596505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe66e3-a3b1-4887-be53-2006dbbb30b5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:10.597167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe66e3-a3b1-4887-be53-2006dbbb30b5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:10.598741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe66e3-a3b1-4887-be53-2006dbbb30b5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-c2fe66e3-a3b1-4887-be53-2006dbbb30b5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:10.610540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:10.611556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:17:10.612429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:10.614697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 491/992] 10.222.0.24 () {56 vars in 1105 bytes} [Wed May 25 07:17:10 2022] GET /identity/v3/services/image => generated 86 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:10.618625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f16d1c-1a5a-4b08-bc4f-8067f5cdc9eb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:10.719495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f16d1c-1a5a-4b08-bc4f-8067f5cdc9eb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:10.754256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752e0fc-6cdc-41cc-8e85-9f4327fac291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:10.754993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752e0fc-6cdc-41cc-8e85-9f4327fac291 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:10.755277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752e0fc-6cdc-41cc-8e85-9f4327fac291 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:10.755555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752e0fc-6cdc-41cc-8e85-9f4327fac291 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:10.756261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752e0fc-6cdc-41cc-8e85-9f4327fac291 None admin] RBAC: Adding query filter params (name=image) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:10.756598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752e0fc-6cdc-41cc-8e85-9f4327fac291 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:10.758048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752e0fc-6cdc-41cc-8e85-9f4327fac291 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:10.767620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 502/993] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:10 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:10.768588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe66e3-a3b1-4887-be53-2006dbbb30b5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:10.835848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:10.871367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe66e3-a3b1-4887-be53-2006dbbb30b5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:10.910080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23606788-71c6-47cb-ac2c-b55c107e7b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:10.910973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23606788-71c6-47cb-ac2c-b55c107e7b95 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:10.911254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23606788-71c6-47cb-ac2c-b55c107e7b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:10.911531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23606788-71c6-47cb-ac2c-b55c107e7b95 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:10.912246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23606788-71c6-47cb-ac2c-b55c107e7b95 None admin] RBAC: Adding query filter params (type=image) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:10.912580 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23606788-71c6-47cb-ac2c-b55c107e7b95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:10.913954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23606788-71c6-47cb-ac2c-b55c107e7b95 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:10.924570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 492/994] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:10 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:11.087150 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2966-1945-4d7e-aab0-5731003da931 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.087481 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2966-1945-4d7e-aab0-5731003da931 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.087706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc2966-1945-4d7e-aab0-5731003da931 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.089339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 503/995] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:11.095125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693fd55-0483-4a78-a0db-5387d3ef54f6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.095407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693fd55-0483-4a78-a0db-5387d3ef54f6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.095690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693fd55-0483-4a78-a0db-5387d3ef54f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.115094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3693fd55-0483-4a78-a0db-5387d3ef54f6 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:11.116651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3693fd55-0483-4a78-a0db-5387d3ef54f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:11.185933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 493/996] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:11.201767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dd07b-bbd4-49fe-9612-7155d9207604 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.202056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dd07b-bbd4-49fe-9612-7155d9207604 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.202322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753dd07b-bbd4-49fe-9612-7155d9207604 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.203816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 504/997] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:11.207877 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693fd55-0483-4a78-a0db-5387d3ef54f6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:11.208426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6062-3847-4fab-9389-5bf23fdaf64d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.208739 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6062-3847-4fab-9389-5bf23fdaf64d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.209016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a6062-3847-4fab-9389-5bf23fdaf64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.225986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-be8a6062-3847-4fab-9389-5bf23fdaf64d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:11.227152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-be8a6062-3847-4fab-9389-5bf23fdaf64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:11.277043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:11.282689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:11.305493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 505/998] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:11 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:11.320961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693fd55-0483-4a78-a0db-5387d3ef54f6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:11.327608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6062-3847-4fab-9389-5bf23fdaf64d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:11.358725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96638d-00ac-4718-b88c-a10030392555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:11.360179 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96638d-00ac-4718-b88c-a10030392555 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.360502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96638d-00ac-4718-b88c-a10030392555 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.360771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a96638d-00ac-4718-b88c-a10030392555 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.361733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96638d-00ac-4718-b88c-a10030392555 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:11.363241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a96638d-00ac-4718-b88c-a10030392555 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0a96638d-00ac-4718-b88c-a10030392555 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:11.375876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:11.383644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:11.384908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 494/999] 10.222.0.24 () {56 vars in 1126 bytes} [Wed May 25 07:17:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:11.385751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96638d-00ac-4718-b88c-a10030392555 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:11.436400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a6062-3847-4fab-9389-5bf23fdaf64d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:11.471790 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb9501-98c7-41fa-8000-2aec1ee0ca3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:11.478785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb9501-98c7-41fa-8000-2aec1ee0ca3a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.478785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb9501-98c7-41fa-8000-2aec1ee0ca3a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.478785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeb9501-98c7-41fa-8000-2aec1ee0ca3a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.478785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb9501-98c7-41fa-8000-2aec1ee0ca3a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:11.478785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeb9501-98c7-41fa-8000-2aec1ee0ca3a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-daeb9501-98c7-41fa-8000-2aec1ee0ca3a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:11.487880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:11.489468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:11.490330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 506/1000] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:17:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:11.497662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb9501-98c7-41fa-8000-2aec1ee0ca3a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:11.498509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a96638d-00ac-4718-b88c-a10030392555 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:11.574626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:11.596506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2822-fae8-42e0-848e-0794af3b8910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:11.597186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2822-fae8-42e0-848e-0794af3b8910 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.597470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2822-fae8-42e0-848e-0794af3b8910 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.597745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bf2822-fae8-42e0-848e-0794af3b8910 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.598080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:11.598758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf2822-fae8-42e0-848e-0794af3b8910 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:11.598960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf2822-fae8-42e0-848e-0794af3b8910 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:11.601126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bf2822-fae8-42e0-848e-0794af3b8910 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:11.612027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 495/1001] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:17:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:11.613780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2822-fae8-42e0-848e-0794af3b8910 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:11.657114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeb9501-98c7-41fa-8000-2aec1ee0ca3a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:11.693717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2262610-d134-45be-8290-2949efa3c806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:11.694389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2262610-d134-45be-8290-2949efa3c806 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.694670 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2262610-d134-45be-8290-2949efa3c806 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.694944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2262610-d134-45be-8290-2949efa3c806 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.695736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2262610-d134-45be-8290-2949efa3c806 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:11.696043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2262610-d134-45be-8290-2949efa3c806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:11.697899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2262610-d134-45be-8290-2949efa3c806 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:11.708241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 507/1002] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:17:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:11.709748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2262610-d134-45be-8290-2949efa3c806 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:11.722103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bf2822-fae8-42e0-848e-0794af3b8910 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:11.758906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ccd4b-4cd2-4ceb-8301-8280ef13a60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:11.761697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ccd4b-4cd2-4ceb-8301-8280ef13a60c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.761697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ccd4b-4cd2-4ceb-8301-8280ef13a60c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.761697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ccd4b-4cd2-4ceb-8301-8280ef13a60c None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.761697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ccd4b-4cd2-4ceb-8301-8280ef13a60c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:11.761697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ccd4b-4cd2-4ceb-8301-8280ef13a60c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:11.762520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ccd4b-4cd2-4ceb-8301-8280ef13a60c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:11.767541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 496/1003] 10.222.0.24 () {56 vars in 1122 bytes} [Wed May 25 07:17:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:11.773217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ccd4b-4cd2-4ceb-8301-8280ef13a60c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:11.820715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2262610-d134-45be-8290-2949efa3c806 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:11.828231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:11.831276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:11.857013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30d222-ae6f-43b0-b65c-ebe9a77bd71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:11.857675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30d222-ae6f-43b0-b65c-ebe9a77bd71b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.857957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30d222-ae6f-43b0-b65c-ebe9a77bd71b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.858230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e30d222-ae6f-43b0-b65c-ebe9a77bd71b None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.858933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30d222-ae6f-43b0-b65c-ebe9a77bd71b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:11.859241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30d222-ae6f-43b0-b65c-ebe9a77bd71b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:11.860638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e30d222-ae6f-43b0-b65c-ebe9a77bd71b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:11.866542 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 508/1004] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:17:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:11.872660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30d222-ae6f-43b0-b65c-ebe9a77bd71b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:11.883483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ccd4b-4cd2-4ceb-8301-8280ef13a60c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:11.918483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098a4e0-189e-4ae6-bcee-80804e32447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:11.919195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098a4e0-189e-4ae6-bcee-80804e32447d None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:11.919478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098a4e0-189e-4ae6-bcee-80804e32447d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:11.919753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098a4e0-189e-4ae6-bcee-80804e32447d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:11.920522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098a4e0-189e-4ae6-bcee-80804e32447d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:11.921939 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098a4e0-189e-4ae6-bcee-80804e32447d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:11.972259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e30d222-ae6f-43b0-b65c-ebe9a77bd71b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:11.996550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 497/1005] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 07:17:11 2022] POST /identity/v3/endpoints => generated 325 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:17:12.027789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ec3fba-cfda-4605-ac12-6dc9a8898876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:12.028494 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec3fba-cfda-4605-ac12-6dc9a8898876 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:12.028782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec3fba-cfda-4605-ac12-6dc9a8898876 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:12.029053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ec3fba-cfda-4605-ac12-6dc9a8898876 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:12.029881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec3fba-cfda-4605-ac12-6dc9a8898876 None admin] RBAC: Adding query filter params (interface=public, service_id=1f90f228818244558b61330566e00d0d, region_id=RegionOne) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:12.030195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec3fba-cfda-4605-ac12-6dc9a8898876 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:12.031663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ec3fba-cfda-4605-ac12-6dc9a8898876 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:12.039925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 509/1006] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 07:17:11 2022] GET /identity/v3/endpoints?service_id=1f90f228818244558b61330566e00d0d&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:12.045719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098a4e0-189e-4ae6-bcee-80804e32447d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:12.157470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098a4e0-189e-4ae6-bcee-80804e32447d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:12.172166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:12.193898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ce8ace-1dd5-40d1-81d5-cad92fadffbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:12.194649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8ace-1dd5-40d1-81d5-cad92fadffbb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:12.194995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8ace-1dd5-40d1-81d5-cad92fadffbb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:12.195333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ce8ace-1dd5-40d1-81d5-cad92fadffbb None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:12.196645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce8ace-1dd5-40d1-81d5-cad92fadffbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:12.197547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ce8ace-1dd5-40d1-81d5-cad92fadffbb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:12.208574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 498/1007] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 07:17:12 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:17:13.174133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f438dc-1eb8-46e4-9a24-2e161adc9342 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:13.174872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f438dc-1eb8-46e4-9a24-2e161adc9342 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:13.174872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f438dc-1eb8-46e4-9a24-2e161adc9342 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:13.176603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 510/1008] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:13.182475 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856063d-6b69-4dc3-a195-d22f794f9282 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:13.182906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856063d-6b69-4dc3-a195-d22f794f9282 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:13.183107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2856063d-6b69-4dc3-a195-d22f794f9282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:13.201482 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2856063d-6b69-4dc3-a195-d22f794f9282 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:13.202768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2856063d-6b69-4dc3-a195-d22f794f9282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:13.282999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 499/1009] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:13 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:13.309196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f438dc-1eb8-46e4-9a24-2e161adc9342 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:13.348184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:13.436223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f438dc-1eb8-46e4-9a24-2e161adc9342 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:13.476051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8af897a-0ed7-42ac-91e0-ba3696d4fb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:13.476757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af897a-0ed7-42ac-91e0-ba3696d4fb84 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:13.477037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af897a-0ed7-42ac-91e0-ba3696d4fb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:13.477304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8af897a-0ed7-42ac-91e0-ba3696d4fb84 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:13.478037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af897a-0ed7-42ac-91e0-ba3696d4fb84 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:13.479764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8af897a-0ed7-42ac-91e0-ba3696d4fb84 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:13.599552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 511/1010] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:17:13 2022] POST /identity/v3/services => generated 242 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:17:14.292415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68f811-f2fe-40e6-9ba2-496f4011bb5a None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:14.292989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68f811-f2fe-40e6-9ba2-496f4011bb5a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:14.292989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68f811-f2fe-40e6-9ba2-496f4011bb5a None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:14.294659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 500/1011] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:14.300266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b9581-1efc-470b-b238-4812b24903c5 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:14.300918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b9581-1efc-470b-b238-4812b24903c5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:14.301128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b9581-1efc-470b-b238-4812b24903c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:14.319633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b97b9581-1efc-470b-b238-4812b24903c5 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:14.320830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b97b9581-1efc-470b-b238-4812b24903c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:14.396810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 512/1012] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:14 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:14.419729 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68f811-f2fe-40e6-9ba2-496f4011bb5a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:14.474955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a4db2-9e52-494d-a857-f257ec5a351c None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:14.475313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a4db2-9e52-494d-a857-f257ec5a351c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:14.475595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a4db2-9e52-494d-a857-f257ec5a351c None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:14.477153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 513/1013] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:14.481909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22060097-7df4-4d96-8183-04944756b92e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:14.482195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22060097-7df4-4d96-8183-04944756b92e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:14.482473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22060097-7df4-4d96-8183-04944756b92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:14.499368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-22060097-7df4-4d96-8183-04944756b92e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:14.500563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-22060097-7df4-4d96-8183-04944756b92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:14.514895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:14.527981 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68f811-f2fe-40e6-9ba2-496f4011bb5a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:14.536800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:14.568149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311882a-1bb6-4a10-89e8-72fa463bff22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:14.568901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311882a-1bb6-4a10-89e8-72fa463bff22 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:14.569459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311882a-1bb6-4a10-89e8-72fa463bff22 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:14.569735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311882a-1bb6-4a10-89e8-72fa463bff22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:14.570926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311882a-1bb6-4a10-89e8-72fa463bff22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:14.572346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311882a-1bb6-4a10-89e8-72fa463bff22 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:14.573723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 514/1014] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:14 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:14.576541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 501/1015] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:14.580055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22060097-7df4-4d96-8183-04944756b92e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:14.600418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311882a-1bb6-4a10-89e8-72fa463bff22 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:14.687100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22060097-7df4-4d96-8183-04944756b92e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:14.703799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311882a-1bb6-4a10-89e8-72fa463bff22 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:14.724808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a141910-2ed4-4cde-af23-ca84ffa81e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:14.725491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a141910-2ed4-4cde-af23-ca84ffa81e10 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:14.725773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a141910-2ed4-4cde-af23-ca84ffa81e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:14.726048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a141910-2ed4-4cde-af23-ca84ffa81e10 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:14.726774 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a141910-2ed4-4cde-af23-ca84ffa81e10 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:14.728300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a141910-2ed4-4cde-af23-ca84ffa81e10 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:14.741717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58830-40f2-462e-a49e-83064d949bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:14.742531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58830-40f2-462e-a49e-83064d949bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:14.742836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58830-40f2-462e-a49e-83064d949bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:14.743074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e58830-40f2-462e-a49e-83064d949bd3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:14.743951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58830-40f2-462e-a49e-83064d949bd3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:14.745174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e58830-40f2-462e-a49e-83064d949bd3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-95e58830-40f2-462e-a49e-83064d949bd3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:14.757835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:14.759055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:17:14.760282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:14.764043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 502/1016] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:17:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:14.764902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58830-40f2-462e-a49e-83064d949bd3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:14.805659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:14.831472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:14.838158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 515/1017] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:17:14 2022] POST /identity/v3/projects => generated 311 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:17:14.873799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e58830-40f2-462e-a49e-83064d949bd3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:14.915423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dca94-45d9-42b9-a6d1-9e4e5f97b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:14.916192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dca94-45d9-42b9-a6d1-9e4e5f97b15a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:14.916494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dca94-45d9-42b9-a6d1-9e4e5f97b15a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:14.916831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dca94-45d9-42b9-a6d1-9e4e5f97b15a None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:14.917544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dca94-45d9-42b9-a6d1-9e4e5f97b15a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:14.917855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dca94-45d9-42b9-a6d1-9e4e5f97b15a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:14.919363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dca94-45d9-42b9-a6d1-9e4e5f97b15a None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:14.928723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 503/1018] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:17:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:14.931915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a141910-2ed4-4cde-af23-ca84ffa81e10 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:15.041841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a141910-2ed4-4cde-af23-ca84ffa81e10 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:15.075661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636ddb9-ea90-47c4-b278-8d650b399f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:15.076318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636ddb9-ea90-47c4-b278-8d650b399f6f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:15.076631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636ddb9-ea90-47c4-b278-8d650b399f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:15.076906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636ddb9-ea90-47c4-b278-8d650b399f6f None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:15.077608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636ddb9-ea90-47c4-b278-8d650b399f6f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:15.077914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636ddb9-ea90-47c4-b278-8d650b399f6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:15.079276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9636ddb9-ea90-47c4-b278-8d650b399f6f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:15.085341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 516/1019] 10.222.0.24 () {56 vars in 1112 bytes} [Wed May 25 07:17:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:15.090685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dca94-45d9-42b9-a6d1-9e4e5f97b15a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:15.197736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dca94-45d9-42b9-a6d1-9e4e5f97b15a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:15.199227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:15.233284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb12d9ac-cd0d-49d5-8f0d-d712454d9aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:15.233951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12d9ac-cd0d-49d5-8f0d-d712454d9aad None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:15.234295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12d9ac-cd0d-49d5-8f0d-d712454d9aad None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:15.234567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb12d9ac-cd0d-49d5-8f0d-d712454d9aad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:15.235329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12d9ac-cd0d-49d5-8f0d-d712454d9aad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:15.236738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb12d9ac-cd0d-49d5-8f0d-d712454d9aad None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:15.330391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 504/1020] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 07:17:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:17:15.843683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941d68-8ae6-41ad-8373-91b947e3b598 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:15.844181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941d68-8ae6-41ad-8373-91b947e3b598 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:15.844181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3941d68-8ae6-41ad-8373-91b947e3b598 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:15.845680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 517/1021] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:15.850758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368cd0-5440-407c-92f1-863b4e545c24 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:15.851051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368cd0-5440-407c-92f1-863b4e545c24 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:15.851327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f368cd0-5440-407c-92f1-863b4e545c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:15.868216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8f368cd0-5440-407c-92f1-863b4e545c24 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:15.869422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8f368cd0-5440-407c-92f1-863b4e545c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:15.941161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 505/1022] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:15 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:15.963826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941d68-8ae6-41ad-8373-91b947e3b598 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:16.031226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:16.071237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3941d68-8ae6-41ad-8373-91b947e3b598 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:16.105870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ded1b-41b2-4a93-91ec-909f950d5654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:16.106590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ded1b-41b2-4a93-91ec-909f950d5654 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:16.106870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ded1b-41b2-4a93-91ec-909f950d5654 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:16.107141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ded1b-41b2-4a93-91ec-909f950d5654 None admin] PATH_INFO: `/v3/services/image` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:16.107792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ded1b-41b2-4a93-91ec-909f950d5654 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:16.109196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7ded1b-41b2-4a93-91ec-909f950d5654 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-9e7ded1b-41b2-4a93-91ec-909f950d5654 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:16.121933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:16.122961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:16.123990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 518/1023] 10.222.0.24 () {56 vars in 1105 bytes} [Wed May 25 07:17:15 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:16.129680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368cd0-5440-407c-92f1-863b4e545c24 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:16.219649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:16.236054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f368cd0-5440-407c-92f1-863b4e545c24 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:16.279397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcab56-c8ce-40de-981f-838506b6b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:16.280088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcab56-c8ce-40de-981f-838506b6b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:16.280579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcab56-c8ce-40de-981f-838506b6b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:16.280855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcab56-c8ce-40de-981f-838506b6b6a6 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:16.281568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcab56-c8ce-40de-981f-838506b6b6a6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:16.281869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcab56-c8ce-40de-981f-838506b6b6a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:16.283224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcab56-c8ce-40de-981f-838506b6b6a6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:16.288767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 506/1024] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:16.294243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ded1b-41b2-4a93-91ec-909f950d5654 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:16.395462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ded1b-41b2-4a93-91ec-909f950d5654 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:16.420737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:16.429366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4767ab-35ec-4b09-a67a-6aa1d0db36a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:16.430070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4767ab-35ec-4b09-a67a-6aa1d0db36a0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:16.430452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4767ab-35ec-4b09-a67a-6aa1d0db36a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:16.430639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4767ab-35ec-4b09-a67a-6aa1d0db36a0 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:16.431338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4767ab-35ec-4b09-a67a-6aa1d0db36a0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:16.431641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4767ab-35ec-4b09-a67a-6aa1d0db36a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:16.435856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4767ab-35ec-4b09-a67a-6aa1d0db36a0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:16.443080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 519/1025] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:16 2022] GET /identity/v3/services?type=image => generated 350 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:16.444302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcab56-c8ce-40de-981f-838506b6b6a6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:16.543134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcab56-c8ce-40de-981f-838506b6b6a6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:16.580163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3ece09-3a0c-4e71-98e9-ba1f7ce1b584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:16.584607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ece09-3a0c-4e71-98e9-ba1f7ce1b584 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:16.584607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ece09-3a0c-4e71-98e9-ba1f7ce1b584 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:16.584607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3ece09-3a0c-4e71-98e9-ba1f7ce1b584 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:16.584607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ece09-3a0c-4e71-98e9-ba1f7ce1b584 None admin] RBAC: Adding query filter params (interface=public, service_id=3f82a4dda9424f64bf5d3631aa656999, region_id=RegionOne) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:16.584607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ece09-3a0c-4e71-98e9-ba1f7ce1b584 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:16.584607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3ece09-3a0c-4e71-98e9-ba1f7ce1b584 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:16.600731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 507/1026] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 07:17:16 2022] GET /identity/v3/endpoints?service_id=3f82a4dda9424f64bf5d3631aa656999&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:16.601874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4767ab-35ec-4b09-a67a-6aa1d0db36a0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:16.701412 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4767ab-35ec-4b09-a67a-6aa1d0db36a0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:16.734784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff70de10-065b-4a97-84ce-efd8e26e0d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:16.735451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70de10-065b-4a97-84ce-efd8e26e0d1a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:16.735730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70de10-065b-4a97-84ce-efd8e26e0d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:16.735997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff70de10-065b-4a97-84ce-efd8e26e0d1a None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:16.736753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70de10-065b-4a97-84ce-efd8e26e0d1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:16.738661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff70de10-065b-4a97-84ce-efd8e26e0d1a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:16.752555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 520/1027] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 07:17:16 2022] GET /identity/v3/services => generated 1957 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:17:17.172456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540179-2322-485a-8dd2-4ac347970d1c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:17.172776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540179-2322-485a-8dd2-4ac347970d1c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:17.172983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08540179-2322-485a-8dd2-4ac347970d1c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:17.174432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 508/1028] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:17.180022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70e516-aaf5-470f-9e38-b6ea8e7a3556 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:17.180624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70e516-aaf5-470f-9e38-b6ea8e7a3556 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:17.180624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70e516-aaf5-470f-9e38-b6ea8e7a3556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:17.198541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cb70e516-aaf5-470f-9e38-b6ea8e7a3556 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:17.199759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cb70e516-aaf5-470f-9e38-b6ea8e7a3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:17.255234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:17.276525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 521/1029] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:17.297923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540179-2322-485a-8dd2-4ac347970d1c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:17.313451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:17.404291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08540179-2322-485a-8dd2-4ac347970d1c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:17.439736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0157257d-21fa-4ace-bd56-a5c48714def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:17.440465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157257d-21fa-4ace-bd56-a5c48714def6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:17.440770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157257d-21fa-4ace-bd56-a5c48714def6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:17.441044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0157257d-21fa-4ace-bd56-a5c48714def6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:17.443006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157257d-21fa-4ace-bd56-a5c48714def6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:17.444442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0157257d-21fa-4ace-bd56-a5c48714def6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:17.450616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 509/1030] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:17.451923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70e516-aaf5-470f-9e38-b6ea8e7a3556 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:17.558056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70e516-aaf5-470f-9e38-b6ea8e7a3556 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:17.599018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224c9e1-4f65-460b-a583-c7f3281ba083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:17.599692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224c9e1-4f65-460b-a583-c7f3281ba083 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:17.599969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224c9e1-4f65-460b-a583-c7f3281ba083 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:17.600240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4224c9e1-4f65-460b-a583-c7f3281ba083 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:17.600998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224c9e1-4f65-460b-a583-c7f3281ba083 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:17.602430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4224c9e1-4f65-460b-a583-c7f3281ba083 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:17.695282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91097f5a-b75c-42fb-82e9-63cb8fbdc502 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:17.695568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91097f5a-b75c-42fb-82e9-63cb8fbdc502 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:17.695850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91097f5a-b75c-42fb-82e9-63cb8fbdc502 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:17.697267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 510/1031] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:17.702199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18228c4-0ea4-4ed9-9d53-e0e307c7116d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:17.702488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18228c4-0ea4-4ed9-9d53-e0e307c7116d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:17.702764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18228c4-0ea4-4ed9-9d53-e0e307c7116d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:17.728506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 522/1032] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:17:17 2022] POST /identity/v3/users => generated 285 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:17:17.728731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c18228c4-0ea4-4ed9-9d53-e0e307c7116d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:17.728731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c18228c4-0ea4-4ed9-9d53-e0e307c7116d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:17.804944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 511/1033] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:17 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:17.829188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224c9e1-4f65-460b-a583-c7f3281ba083 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:17.877927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:17.942133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4224c9e1-4f65-460b-a583-c7f3281ba083 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:17.977335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2990e-3d55-42ba-818a-9ad8ee08afbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:17.978083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2990e-3d55-42ba-818a-9ad8ee08afbb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:17.978366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2990e-3d55-42ba-818a-9ad8ee08afbb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:17.978642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f2990e-3d55-42ba-818a-9ad8ee08afbb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:17.990378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f2990e-3d55-42ba-818a-9ad8ee08afbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-30f2990e-3d55-42ba-818a-9ad8ee08afbb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:17.998646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:17.999576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:18.000495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 523/1034] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 07:17:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:18.006571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18228c4-0ea4-4ed9-9d53-e0e307c7116d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:18.018544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:18.107110 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18228c4-0ea4-4ed9-9d53-e0e307c7116d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:18.141105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85b380-0e9f-459a-9459-179d058ba3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:18.141786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85b380-0e9f-459a-9459-179d058ba3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:18.142071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85b380-0e9f-459a-9459-179d058ba3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:18.142348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85b380-0e9f-459a-9459-179d058ba3f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:18.143101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85b380-0e9f-459a-9459-179d058ba3f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:18.143410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85b380-0e9f-459a-9459-179d058ba3f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:18.145369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85b380-0e9f-459a-9459-179d058ba3f5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:18.153878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 512/1035] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 07:17:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:18.159255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2990e-3d55-42ba-818a-9ad8ee08afbb None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:18.260792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f2990e-3d55-42ba-818a-9ad8ee08afbb None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:18.262262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:18.294255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85188714-83a7-4d69-870b-008a295adcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:18.295061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85188714-83a7-4d69-870b-008a295adcd1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:18.295345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85188714-83a7-4d69-870b-008a295adcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:18.295621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85188714-83a7-4d69-870b-008a295adcd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:18.307118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85188714-83a7-4d69-870b-008a295adcd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:18.308843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85188714-83a7-4d69-870b-008a295adcd1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-85188714-83a7-4d69-870b-008a295adcd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:18.326406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:18.327378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:18.328323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:18.328323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:18.328323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:18.328323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:18.329345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 524/1036] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:18.333902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85b380-0e9f-459a-9459-179d058ba3f5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:18.406898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:18.437738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85b380-0e9f-459a-9459-179d058ba3f5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:18.473357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564a53-c2ac-4fe8-beec-c91f9d0b0705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:18.474019 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564a53-c2ac-4fe8-beec-c91f9d0b0705 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:18.474295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564a53-c2ac-4fe8-beec-c91f9d0b0705 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:18.474567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a564a53-c2ac-4fe8-beec-c91f9d0b0705 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:18.475286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564a53-c2ac-4fe8-beec-c91f9d0b0705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:18.475592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564a53-c2ac-4fe8-beec-c91f9d0b0705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:18.476982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a564a53-c2ac-4fe8-beec-c91f9d0b0705 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:18.493562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 513/1037] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:18.494826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85188714-83a7-4d69-870b-008a295adcd1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:18.605465 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85188714-83a7-4d69-870b-008a295adcd1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:18.639111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2713ab-7f5f-4513-93d5-07aaf228fe31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:18.639901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2713ab-7f5f-4513-93d5-07aaf228fe31 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:18.640176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2713ab-7f5f-4513-93d5-07aaf228fe31 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:18.640445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2713ab-7f5f-4513-93d5-07aaf228fe31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:18.648803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2713ab-7f5f-4513-93d5-07aaf228fe31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:18.650249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2713ab-7f5f-4513-93d5-07aaf228fe31 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-db2713ab-7f5f-4513-93d5-07aaf228fe31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:17:18.664255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:18.665399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:17:18.666750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:18.667626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 525/1038] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 07:17:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:18.671084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564a53-c2ac-4fe8-beec-c91f9d0b0705 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:18.771694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a564a53-c2ac-4fe8-beec-c91f9d0b0705 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:18.801278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:18.806529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7962f149-5e55-49d2-b7fd-a205ab86725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:18.807358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962f149-5e55-49d2-b7fd-a205ab86725d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:18.818824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962f149-5e55-49d2-b7fd-a205ab86725d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:18.818824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7962f149-5e55-49d2-b7fd-a205ab86725d None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:18.818824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962f149-5e55-49d2-b7fd-a205ab86725d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:18.818824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962f149-5e55-49d2-b7fd-a205ab86725d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:18.818824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7962f149-5e55-49d2-b7fd-a205ab86725d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:18.835874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 514/1039] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 07:17:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:18.837573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2713ab-7f5f-4513-93d5-07aaf228fe31 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:18.856002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:18.941784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2713ab-7f5f-4513-93d5-07aaf228fe31 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:18.979841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1e059-2ce5-421e-aac9-680faa9940b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:18.980512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1e059-2ce5-421e-aac9-680faa9940b6 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:18.980797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1e059-2ce5-421e-aac9-680faa9940b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:18.981070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1e059-2ce5-421e-aac9-680faa9940b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.022274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1769e5b-201f-4cef-b8b7-cdfd33d5248c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.022581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1769e5b-201f-4cef-b8b7-cdfd33d5248c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.022844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1769e5b-201f-4cef-b8b7-cdfd33d5248c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.024363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 515/1040] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:19.029224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f2d42-7c12-4545-b629-b5646c2b1cfa None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.029517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f2d42-7c12-4545-b629-b5646c2b1cfa None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.029813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f2d42-7c12-4545-b629-b5646c2b1cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.047196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-376f2d42-7c12-4545-b629-b5646c2b1cfa None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:19.048424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-376f2d42-7c12-4545-b629-b5646c2b1cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:19.060579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1e059-2ce5-421e-aac9-680faa9940b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:19.062046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa1e059-2ce5-421e-aac9-680faa9940b6 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:19.078855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:19.122942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 516/1041] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:19.146034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f2d42-7c12-4545-b629-b5646c2b1cfa None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:19.173425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 526/1042] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:17:19.174304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1e059-2ce5-421e-aac9-680faa9940b6 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:19.246919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f2d42-7c12-4545-b629-b5646c2b1cfa None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:19.266944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:19.279677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1e059-2ce5-421e-aac9-680faa9940b6 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:19.282763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb0f2b-2a2a-46e0-ba41-5a9064d15f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:19.283565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb0f2b-2a2a-46e0-ba41-5a9064d15f2c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.283852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb0f2b-2a2a-46e0-ba41-5a9064d15f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.284129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfb0f2b-2a2a-46e0-ba41-5a9064d15f2c None admin] PATH_INFO: `/v3/services/image` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.284827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb0f2b-2a2a-46e0-ba41-5a9064d15f2c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:19.286284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfb0f2b-2a2a-46e0-ba41-5a9064d15f2c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:19.294009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-bdfb0f2b-2a2a-46e0-ba41-5a9064d15f2c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:19.298862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:19.299849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:19.300801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 517/1043] 10.222.0.24 () {56 vars in 1105 bytes} [Wed May 25 07:17:19 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:19.306128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb0f2b-2a2a-46e0-ba41-5a9064d15f2c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:19.316929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4a2a1-43da-44ed-a8ad-62c1ddc5c1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:19.317732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4a2a1-43da-44ed-a8ad-62c1ddc5c1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.318011 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4a2a1-43da-44ed-a8ad-62c1ddc5c1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.318333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4a2a1-43da-44ed-a8ad-62c1ddc5c1b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.330132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4a2a1-43da-44ed-a8ad-62c1ddc5c1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:19.331587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d4a2a1-43da-44ed-a8ad-62c1ddc5c1b4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c6d4a2a1-43da-44ed-a8ad-62c1ddc5c1b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:19.350998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:19.352148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:19.353113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:19.353113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:19.353113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:19.353113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:19.353113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 527/1044] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:19.357785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4a2a1-43da-44ed-a8ad-62c1ddc5c1b4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:19.418953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfb0f2b-2a2a-46e0-ba41-5a9064d15f2c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:19.457703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fc429-f250-4024-bf81-fd129c0192a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:19.458650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fc429-f250-4024-bf81-fd129c0192a0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.458935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fc429-f250-4024-bf81-fd129c0192a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.459213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2fc429-f250-4024-bf81-fd129c0192a0 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.460085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fc429-f250-4024-bf81-fd129c0192a0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:19.460745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fc429-f250-4024-bf81-fd129c0192a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:19.462571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2fc429-f250-4024-bf81-fd129c0192a0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:19.474322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4a2a1-43da-44ed-a8ad-62c1ddc5c1b4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:19.474487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 518/1045] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:19.475988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fc429-f250-4024-bf81-fd129c0192a0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:19.510155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1454984-851c-4b7c-8486-e6b74553762e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:19.510986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1454984-851c-4b7c-8486-e6b74553762e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.511577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1454984-851c-4b7c-8486-e6b74553762e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.511868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1454984-851c-4b7c-8486-e6b74553762e None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.512779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1454984-851c-4b7c-8486-e6b74553762e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:19.513092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1454984-851c-4b7c-8486-e6b74553762e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:19.514463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1454984-851c-4b7c-8486-e6b74553762e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:19.531820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 528/1046] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:19.532831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1454984-851c-4b7c-8486-e6b74553762e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:19.535492 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:19.561165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:19.596405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2fc429-f250-4024-bf81-fd129c0192a0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:19.633676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a1847-7f11-47a2-a960-ffa87b4d8313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:19.634384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a1847-7f11-47a2-a960-ffa87b4d8313 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.634663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a1847-7f11-47a2-a960-ffa87b4d8313 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.634938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a1847-7f11-47a2-a960-ffa87b4d8313 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.635647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a1847-7f11-47a2-a960-ffa87b4d8313 None admin] RBAC: Adding query filter params (type=image) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:19.635952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a1847-7f11-47a2-a960-ffa87b4d8313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:19.637358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6a1847-7f11-47a2-a960-ffa87b4d8313 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:19.641772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1454984-851c-4b7c-8486-e6b74553762e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:19.642573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 519/1047] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:19 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:19.648450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a1847-7f11-47a2-a960-ffa87b4d8313 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:19.677321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5423b-f07c-4929-b303-ec160798db8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:19.678036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5423b-f07c-4929-b303-ec160798db8a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.678318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5423b-f07c-4929-b303-ec160798db8a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.678596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5423b-f07c-4929-b303-ec160798db8a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.686025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5423b-f07c-4929-b303-ec160798db8a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:19.687561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f5423b-f07c-4929-b303-ec160798db8a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-c1f5423b-f07c-4929-b303-ec160798db8a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:17:19.702076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:19.702997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:19.703927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:17:19.703927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:17:19.703927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:17:19.703927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:17:19.703927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:17:19.703927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:17:19.703927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:19.703927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:19.703927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 529/1048] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:19.709748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5423b-f07c-4929-b303-ec160798db8a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:19.757223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6a1847-7f11-47a2-a960-ffa87b4d8313 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:19.771946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:19.794642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7c93b-1d6f-4f69-bd47-717f62f9a66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:19.795391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7c93b-1d6f-4f69-bd47-717f62f9a66f None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.795747 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7c93b-1d6f-4f69-bd47-717f62f9a66f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.796094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7c93b-1d6f-4f69-bd47-717f62f9a66f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.796951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7c93b-1d6f-4f69-bd47-717f62f9a66f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:19.798403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7c93b-1d6f-4f69-bd47-717f62f9a66f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:19.808550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:19.823543 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5423b-f07c-4929-b303-ec160798db8a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:19.859393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95705ccd-28ea-47bc-a9ad-644ace371481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:19.860078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705ccd-28ea-47bc-a9ad-644ace371481 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:19.860361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705ccd-28ea-47bc-a9ad-644ace371481 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:19.860668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705ccd-28ea-47bc-a9ad-644ace371481 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:19.861476 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95705ccd-28ea-47bc-a9ad-644ace371481 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:19.861793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95705ccd-28ea-47bc-a9ad-644ace371481 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:19.864104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95705ccd-28ea-47bc-a9ad-644ace371481 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:19.872212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 520/1049] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 07:17:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:17:19.884527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 530/1050] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:19.890878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7c93b-1d6f-4f69-bd47-717f62f9a66f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:20.010136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7c93b-1d6f-4f69-bd47-717f62f9a66f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:20.039044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c57bf0-3fbc-436f-bebf-b3ea966915b4 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:20.039337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c57bf0-3fbc-436f-bebf-b3ea966915b4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:20.039616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c57bf0-3fbc-436f-bebf-b3ea966915b4 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:20.041207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 531/1051] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:20.046933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb13a7-071a-4b88-9773-139195663cf6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:20.047220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb13a7-071a-4b88-9773-139195663cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:20.047496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb13a7-071a-4b88-9773-139195663cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:20.048891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c9a5a-7697-4a26-8496-1f15246f436f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:20.049350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c9a5a-7697-4a26-8496-1f15246f436f None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:20.049628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c9a5a-7697-4a26-8496-1f15246f436f None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:20.049900 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40c9a5a-7697-4a26-8496-1f15246f436f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:20.051541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c9a5a-7697-4a26-8496-1f15246f436f None admin] RBAC: Adding query filter params (role.id=04321844426a44e5b76b8c33ef3363a2, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=3a06a84967694e68a3a77bf29f16ee3b) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:20.051813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c9a5a-7697-4a26-8496-1f15246f436f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:20.053283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40c9a5a-7697-4a26-8496-1f15246f436f None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:20.064692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 521/1052] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:17:19 2022] GET /identity/v3/role_assignments?user.id=3a06a84967694e68a3a77bf29f16ee3b&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=04321844426a44e5b76b8c33ef3363a2 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:20.067519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-84fb13a7-071a-4b88-9773-139195663cf6 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:20.068797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-84fb13a7-071a-4b88-9773-139195663cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:20.152566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 532/1053] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:20.176902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c9a5a-7697-4a26-8496-1f15246f436f None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:20.209047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:20.289771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40c9a5a-7697-4a26-8496-1f15246f436f None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:20.325022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b254042-c12e-481e-b989-7d5145e0e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:20.325820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b254042-c12e-481e-b989-7d5145e0e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:20.326105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b254042-c12e-481e-b989-7d5145e0e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:20.326382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b254042-c12e-481e-b989-7d5145e0e3b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:20.337683 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b254042-c12e-481e-b989-7d5145e0e3b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-8b254042-c12e-481e-b989-7d5145e0e3b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:20.345667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:20.346602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:20.352664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 522/1054] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:20.355087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb13a7-071a-4b88-9773-139195663cf6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:20.435881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:20.458412 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fb13a7-071a-4b88-9773-139195663cf6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:20.493220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6b35d-85b1-44a9-86f6-9ed781ac2ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:20.493891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6b35d-85b1-44a9-86f6-9ed781ac2ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:20.494171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6b35d-85b1-44a9-86f6-9ed781ac2ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:20.494445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6b35d-85b1-44a9-86f6-9ed781ac2ce7 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:20.495190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6b35d-85b1-44a9-86f6-9ed781ac2ce7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:20.495493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6b35d-85b1-44a9-86f6-9ed781ac2ce7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:20.496918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6b35d-85b1-44a9-86f6-9ed781ac2ce7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:20.510164 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 533/1055] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:20.511581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b254042-c12e-481e-b989-7d5145e0e3b0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:20.608450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:20.620763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b254042-c12e-481e-b989-7d5145e0e3b0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:20.655698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaf15b-3b98-4443-842e-41f74918546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:20.656749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaf15b-3b98-4443-842e-41f74918546d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:20.657042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaf15b-3b98-4443-842e-41f74918546d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:20.657318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aaf15b-3b98-4443-842e-41f74918546d None admin] PATH_INFO: `/v3/users/bf7e9c18fbfc448da2eab551222252b7` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:20.672112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aaf15b-3b98-4443-842e-41f74918546d None admin] RBAC: Authorizing `identity:get_user(user_id=bf7e9c18fbfc448da2eab551222252b7)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:20.673619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aaf15b-3b98-4443-842e-41f74918546d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:20.679964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 523/1056] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:20 2022] GET /identity/v3/users/bf7e9c18fbfc448da2eab551222252b7 => generated 285 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:20.680959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6b35d-85b1-44a9-86f6-9ed781ac2ce7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:20.782928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6b35d-85b1-44a9-86f6-9ed781ac2ce7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:20.817299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50676dec-9bfd-49ed-8655-f7316a831e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:20.817947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50676dec-9bfd-49ed-8655-f7316a831e60 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:20.818229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50676dec-9bfd-49ed-8655-f7316a831e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:20.818502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50676dec-9bfd-49ed-8655-f7316a831e60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:20.826885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:20.886621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50676dec-9bfd-49ed-8655-f7316a831e60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:20.887986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50676dec-9bfd-49ed-8655-f7316a831e60 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:20.989053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 534/1057] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 07:17:20.990802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaf15b-3b98-4443-842e-41f74918546d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:21.092097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aaf15b-3b98-4443-842e-41f74918546d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:21.126132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe61fc-cbd9-44d0-86ee-ce3043ad19d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:21.126993 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe61fc-cbd9-44d0-86ee-ce3043ad19d1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:21.127271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe61fc-cbd9-44d0-86ee-ce3043ad19d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:21.127541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe61fc-cbd9-44d0-86ee-ce3043ad19d1 None admin] PATH_INFO: `/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:21.128878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe61fc-cbd9-44d0-86ee-ce3043ad19d1 None admin] RBAC: Authorizing `identity:get_project(project_id=89470cdcd8b14aa387b6492fb6ba24a5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:21.130391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe61fc-cbd9-44d0-86ee-ce3043ad19d1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:21.137267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 524/1058] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:17:20 2022] GET /identity/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:21.138818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50676dec-9bfd-49ed-8655-f7316a831e60 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:21.182233 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:21.244709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50676dec-9bfd-49ed-8655-f7316a831e60 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:21.278886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e2c8c-ef58-4526-a9f3-ef4ec82063ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:21.279544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2c8c-ef58-4526-a9f3-ef4ec82063ec None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:21.279829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2c8c-ef58-4526-a9f3-ef4ec82063ec None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:21.280105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e2c8c-ef58-4526-a9f3-ef4ec82063ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:21.280965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e2c8c-ef58-4526-a9f3-ef4ec82063ec None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=89470cdcd8b14aa387b6492fb6ba24a5, user.id=bf7e9c18fbfc448da2eab551222252b7) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:21.281283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e2c8c-ef58-4526-a9f3-ef4ec82063ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:21.282720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e2c8c-ef58-4526-a9f3-ef4ec82063ec None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:21.296588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 535/1059] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:17:21 2022] GET /identity/v3/role_assignments?user.id=bf7e9c18fbfc448da2eab551222252b7&scope.project.id=89470cdcd8b14aa387b6492fb6ba24a5&role.id=7c09d078126441909df0a46212ffea63 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:22.160682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87fde3-5425-47cf-92ff-785b260a6bf2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.161237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87fde3-5425-47cf-92ff-785b260a6bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.161486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87fde3-5425-47cf-92ff-785b260a6bf2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.162906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 525/1060] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:22.168330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18a38d-9867-48aa-b137-86f7ba0b2e89 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.168759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18a38d-9867-48aa-b137-86f7ba0b2e89 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.168959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18a38d-9867-48aa-b137-86f7ba0b2e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.185832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-aa18a38d-9867-48aa-b137-86f7ba0b2e89 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:22.186990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-aa18a38d-9867-48aa-b137-86f7ba0b2e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:22.255380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 536/1061] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:22.282435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87fde3-5425-47cf-92ff-785b260a6bf2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:22.291986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa1217-c59f-4900-8d53-1d54355b1b98 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.292279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa1217-c59f-4900-8d53-1d54355b1b98 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.292583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa1217-c59f-4900-8d53-1d54355b1b98 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.294477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 537/1062] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:22.298954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:22.299823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cd31e-4af9-40fa-af01-c0499327544c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.300108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cd31e-4af9-40fa-af01-c0499327544c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.300403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356cd31e-4af9-40fa-af01-c0499327544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.319006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-356cd31e-4af9-40fa-af01-c0499327544c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:22.320211 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-356cd31e-4af9-40fa-af01-c0499327544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:22.349007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:22.400528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 538/1063] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:22.400721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae87fde3-5425-47cf-92ff-785b260a6bf2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:22.418186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cd31e-4af9-40fa-af01-c0499327544c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:22.436043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9766f-b5dd-43ca-8a6d-7f9ce5c76bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:22.436735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9766f-b5dd-43ca-8a6d-7f9ce5c76bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.437015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9766f-b5dd-43ca-8a6d-7f9ce5c76bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.437289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9766f-b5dd-43ca-8a6d-7f9ce5c76bf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.508562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9766f-b5dd-43ca-8a6d-7f9ce5c76bf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:22.510172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9766f-b5dd-43ca-8a6d-7f9ce5c76bf1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:22.525846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:22.527478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356cd31e-4af9-40fa-af01-c0499327544c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:22.562521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fc327-8bdd-4bdd-a41c-74de9204f701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:22.563445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fc327-8bdd-4bdd-a41c-74de9204f701 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.563725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fc327-8bdd-4bdd-a41c-74de9204f701 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.563994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864fc327-8bdd-4bdd-a41c-74de9204f701 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.575039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864fc327-8bdd-4bdd-a41c-74de9204f701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-864fc327-8bdd-4bdd-a41c-74de9204f701 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:22.584383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:22.585487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 539/1064] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 07:17:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:22.591771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fc327-8bdd-4bdd-a41c-74de9204f701 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:22.618521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:22.624516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 526/1065] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:17:22.626416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9766f-b5dd-43ca-8a6d-7f9ce5c76bf1 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:22.701464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864fc327-8bdd-4bdd-a41c-74de9204f701 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:22.738470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36afa7c-bca6-4584-816d-c770f172ede1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:22.739211 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36afa7c-bca6-4584-816d-c770f172ede1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.739320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9766f-b5dd-43ca-8a6d-7f9ce5c76bf1 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:22.739497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36afa7c-bca6-4584-816d-c770f172ede1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.739762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36afa7c-bca6-4584-816d-c770f172ede1 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.740519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36afa7c-bca6-4584-816d-c770f172ede1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:22.740998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36afa7c-bca6-4584-816d-c770f172ede1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:22.743152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36afa7c-bca6-4584-816d-c770f172ede1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:22.752891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:22.753272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 540/1066] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 07:17:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:22.759584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36afa7c-bca6-4584-816d-c770f172ede1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:22.777430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329ab7e-3664-4a87-a0a0-f901e6fed81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:22.778229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329ab7e-3664-4a87-a0a0-f901e6fed81c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.778519 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329ab7e-3664-4a87-a0a0-f901e6fed81c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.778880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f329ab7e-3664-4a87-a0a0-f901e6fed81c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.791324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329ab7e-3664-4a87-a0a0-f901e6fed81c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:22.793282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f329ab7e-3664-4a87-a0a0-f901e6fed81c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f329ab7e-3664-4a87-a0a0-f901e6fed81c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:22.811756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:22.812718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:22.813678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:22.813678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:22.813678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:22.813678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:22.813678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 527/1067] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:22.819363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329ab7e-3664-4a87-a0a0-f901e6fed81c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:22.851659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:22.868616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36afa7c-bca6-4584-816d-c770f172ede1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:22.907737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee679a-5a84-4afb-a766-f3fbf3985438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:22.908561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee679a-5a84-4afb-a766-f3fbf3985438 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.909002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee679a-5a84-4afb-a766-f3fbf3985438 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.909133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee679a-5a84-4afb-a766-f3fbf3985438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.920821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee679a-5a84-4afb-a766-f3fbf3985438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:22.922394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee679a-5a84-4afb-a766-f3fbf3985438 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:22.924701 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f329ab7e-3664-4a87-a0a0-f901e6fed81c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f9ee679a-5a84-4afb-a766-f3fbf3985438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:22.940112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:22.941317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:22.942970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:22.942970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:22.942970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:22.942970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:22.948217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 541/1068] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:22.949172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee679a-5a84-4afb-a766-f3fbf3985438 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:22.969144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644daaae-fe1f-44f2-aded-4a45b17ad495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:22.969739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644daaae-fe1f-44f2-aded-4a45b17ad495 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:22.970021 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644daaae-fe1f-44f2-aded-4a45b17ad495 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:22.970294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644daaae-fe1f-44f2-aded-4a45b17ad495 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:22.971014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644daaae-fe1f-44f2-aded-4a45b17ad495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:22.971745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644daaae-fe1f-44f2-aded-4a45b17ad495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:22.973751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644daaae-fe1f-44f2-aded-4a45b17ad495 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:22.985536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 528/1069] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:23.070986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee679a-5a84-4afb-a766-f3fbf3985438 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:23.108421 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120772e8-2a66-487a-af97-30f84b8e5f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:23.109134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120772e8-2a66-487a-af97-30f84b8e5f63 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.109410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120772e8-2a66-487a-af97-30f84b8e5f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.109684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120772e8-2a66-487a-af97-30f84b8e5f63 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.110422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120772e8-2a66-487a-af97-30f84b8e5f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:23.110727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120772e8-2a66-487a-af97-30f84b8e5f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:23.112138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120772e8-2a66-487a-af97-30f84b8e5f63 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:23.115681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:23.132525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 542/1070] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:23.134153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644daaae-fe1f-44f2-aded-4a45b17ad495 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:23.164169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:23.243722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644daaae-fe1f-44f2-aded-4a45b17ad495 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:23.278580 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104612e-8195-420e-89c4-fa5eae8ba064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:23.279373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104612e-8195-420e-89c4-fa5eae8ba064 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.279651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104612e-8195-420e-89c4-fa5eae8ba064 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.279923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104612e-8195-420e-89c4-fa5eae8ba064 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.288138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104612e-8195-420e-89c4-fa5eae8ba064 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:23.289609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104612e-8195-420e-89c4-fa5eae8ba064 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0104612e-8195-420e-89c4-fa5eae8ba064 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:17:23.305335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:23.306346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:23.307832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 529/1071] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 07:17:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:23.313128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120772e8-2a66-487a-af97-30f84b8e5f63 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:23.414654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120772e8-2a66-487a-af97-30f84b8e5f63 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:23.447268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7bfb9-d15d-46be-8c37-70b71f46ef6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:23.447930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7bfb9-d15d-46be-8c37-70b71f46ef6b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.448206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7bfb9-d15d-46be-8c37-70b71f46ef6b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.448491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7bfb9-d15d-46be-8c37-70b71f46ef6b None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.449461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7bfb9-d15d-46be-8c37-70b71f46ef6b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:23.449766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7bfb9-d15d-46be-8c37-70b71f46ef6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:23.451195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7bfb9-d15d-46be-8c37-70b71f46ef6b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:23.468920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 543/1072] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 07:17:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:23.474996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104612e-8195-420e-89c4-fa5eae8ba064 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:23.508091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fcf29-bfa5-4c9f-8120-1eccb2c2976e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.508384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fcf29-bfa5-4c9f-8120-1eccb2c2976e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.508754 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fcf29-bfa5-4c9f-8120-1eccb2c2976e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.510132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 544/1073] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:23.515340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a61bd-b795-4261-b447-1cf595a78056 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.515632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a61bd-b795-4261-b447-1cf595a78056 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.515905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a61bd-b795-4261-b447-1cf595a78056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.532616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-429a61bd-b795-4261-b447-1cf595a78056 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:23.533812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-429a61bd-b795-4261-b447-1cf595a78056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:23.560737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:23.575510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104612e-8195-420e-89c4-fa5eae8ba064 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:23.584226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:23.602579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 545/1074] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:23.610725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818b9f3-665b-4d0d-bfe8-2fdc4e23fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:23.611524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818b9f3-665b-4d0d-bfe8-2fdc4e23fb85 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.611807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818b9f3-665b-4d0d-bfe8-2fdc4e23fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.612082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818b9f3-665b-4d0d-bfe8-2fdc4e23fb85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.622497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818b9f3-665b-4d0d-bfe8-2fdc4e23fb85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:23.623953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818b9f3-665b-4d0d-bfe8-2fdc4e23fb85 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:23.624702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a61bd-b795-4261-b447-1cf595a78056 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-1818b9f3-665b-4d0d-bfe8-2fdc4e23fb85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:23.641688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:23.642664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:23.643577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:23.643577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:23.643577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:23.643577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:23.643577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 530/1075] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:23.649269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818b9f3-665b-4d0d-bfe8-2fdc4e23fb85 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:23.729182 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429a61bd-b795-4261-b447-1cf595a78056 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:23.752409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818b9f3-665b-4d0d-bfe8-2fdc4e23fb85 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:23.765423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e3298-9594-4d29-86f4-fb52939d4d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:23.766156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3298-9594-4d29-86f4-fb52939d4d4a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.766438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3298-9594-4d29-86f4-fb52939d4d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.766712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e3298-9594-4d29-86f4-fb52939d4d4a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.778625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e3298-9594-4d29-86f4-fb52939d4d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-497e3298-9594-4d29-86f4-fb52939d4d4a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:23.787018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:23.788006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:23.789111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 546/1076] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:17:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:23.791571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c64fed-6eed-4ae9-b3ff-c2ff28d3b479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:23.792237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c64fed-6eed-4ae9-b3ff-c2ff28d3b479 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.792541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c64fed-6eed-4ae9-b3ff-c2ff28d3b479 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.792822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c64fed-6eed-4ae9-b3ff-c2ff28d3b479 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.793553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c64fed-6eed-4ae9-b3ff-c2ff28d3b479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:23.793863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c64fed-6eed-4ae9-b3ff-c2ff28d3b479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:23.794128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e3298-9594-4d29-86f4-fb52939d4d4a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:23.795232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c64fed-6eed-4ae9-b3ff-c2ff28d3b479 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:23.802253 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:23.807393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 531/1077] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:23.812822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c64fed-6eed-4ae9-b3ff-c2ff28d3b479 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:23.841826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:23.895667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e3298-9594-4d29-86f4-fb52939d4d4a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:23.914088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c64fed-6eed-4ae9-b3ff-c2ff28d3b479 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:23.927747 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b5d53-905d-4c95-b173-695f6566cfd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:23.928406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b5d53-905d-4c95-b173-695f6566cfd4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.928715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b5d53-905d-4c95-b173-695f6566cfd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.928992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024b5d53-905d-4c95-b173-695f6566cfd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.929730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b5d53-905d-4c95-b173-695f6566cfd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:23.930037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b5d53-905d-4c95-b173-695f6566cfd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:23.931407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024b5d53-905d-4c95-b173-695f6566cfd4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:23.939751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 547/1078] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:17:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:23.946250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b5d53-905d-4c95-b173-695f6566cfd4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:23.951826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50fe74-6bb1-4ec9-8ad0-1fb442d33d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:23.952661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50fe74-6bb1-4ec9-8ad0-1fb442d33d00 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:23.952946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50fe74-6bb1-4ec9-8ad0-1fb442d33d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:23.953220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50fe74-6bb1-4ec9-8ad0-1fb442d33d00 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:23.960714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50fe74-6bb1-4ec9-8ad0-1fb442d33d00 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:23.962157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50fe74-6bb1-4ec9-8ad0-1fb442d33d00 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-6f50fe74-6bb1-4ec9-8ad0-1fb442d33d00 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:17:23.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:23.977668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:23.978804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:17:23.978804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:17:23.978804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:17:23.978804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:17:23.978804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:17:23.978804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:17:23.978804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:23.978804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:23.978804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 532/1079] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:17:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:23.983269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50fe74-6bb1-4ec9-8ad0-1fb442d33d00 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:24.043807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024b5d53-905d-4c95-b173-695f6566cfd4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:24.044005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:24.051926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:24.081185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d602a2-41bc-4775-bab3-d76012566694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:24.082900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d602a2-41bc-4775-bab3-d76012566694 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:24.083259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d602a2-41bc-4775-bab3-d76012566694 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:24.083538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d602a2-41bc-4775-bab3-d76012566694 None admin] PATH_INFO: `/v3/users/bf7e9c18fbfc448da2eab551222252b7` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:24.084791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d602a2-41bc-4775-bab3-d76012566694 None admin] RBAC: Authorizing `identity:get_user(user_id=bf7e9c18fbfc448da2eab551222252b7)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:24.085952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50fe74-6bb1-4ec9-8ad0-1fb442d33d00 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:24.086241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d602a2-41bc-4775-bab3-d76012566694 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:24.088151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 548/1080] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:23 2022] GET /identity/v3/users/bf7e9c18fbfc448da2eab551222252b7 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:24.093885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d602a2-41bc-4775-bab3-d76012566694 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:24.123023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eed582-2a63-438f-a672-4d907fb39998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:24.123679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eed582-2a63-438f-a672-4d907fb39998 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:24.123959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eed582-2a63-438f-a672-4d907fb39998 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:24.124233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eed582-2a63-438f-a672-4d907fb39998 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:24.125051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eed582-2a63-438f-a672-4d907fb39998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:24.125357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eed582-2a63-438f-a672-4d907fb39998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:24.126783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eed582-2a63-438f-a672-4d907fb39998 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:24.138067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 533/1081] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:24.143958 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eed582-2a63-438f-a672-4d907fb39998 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:24.198145 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d602a2-41bc-4775-bab3-d76012566694 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:24.234903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33da086-469c-43fd-ab25-f204c1178c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:24.235756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33da086-469c-43fd-ab25-f204c1178c51 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:24.236035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33da086-469c-43fd-ab25-f204c1178c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:24.236308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33da086-469c-43fd-ab25-f204c1178c51 None admin] PATH_INFO: `/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:24.237512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33da086-469c-43fd-ab25-f204c1178c51 None admin] RBAC: Authorizing `identity:get_project(project_id=89470cdcd8b14aa387b6492fb6ba24a5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:24.239692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33da086-469c-43fd-ab25-f204c1178c51 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:24.241432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 549/1082] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:17:24 2022] GET /identity/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:24.243527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eed582-2a63-438f-a672-4d907fb39998 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:24.247171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33da086-469c-43fd-ab25-f204c1178c51 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:24.260678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:24.277183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74196c48-f7a9-4c3f-a778-3ade26f6b6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:24.278066 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74196c48-f7a9-4c3f-a778-3ade26f6b6b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:24.278348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74196c48-f7a9-4c3f-a778-3ade26f6b6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:24.278619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74196c48-f7a9-4c3f-a778-3ade26f6b6b0 None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/3a06a84967694e68a3a77bf29f16ee3b/roles/04321844426a44e5b76b8c33ef3363a2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:24.280847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74196c48-f7a9-4c3f-a778-3ade26f6b6b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=3a06a84967694e68a3a77bf29f16ee3b, role_id=04321844426a44e5b76b8c33ef3363a2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:24.282265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74196c48-f7a9-4c3f-a778-3ade26f6b6b0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:24.289348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:24.343223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33da086-469c-43fd-ab25-f204c1178c51 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:24.361043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 534/1083] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:17:24 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/3a06a84967694e68a3a77bf29f16ee3b/roles/04321844426a44e5b76b8c33ef3363a2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:17:24.377353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5a6afa-5159-4c38-bbeb-f124dc70bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:24.378263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6afa-5159-4c38-bbeb-f124dc70bf44 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:24.379266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6afa-5159-4c38-bbeb-f124dc70bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:24.379420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a6afa-5159-4c38-bbeb-f124dc70bf44 None admin] PATH_INFO: `/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5/users/bf7e9c18fbfc448da2eab551222252b7/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:24.381922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6afa-5159-4c38-bbeb-f124dc70bf44 None admin] RBAC: Authorizing `identity:create_grant(project_id=89470cdcd8b14aa387b6492fb6ba24a5, user_id=bf7e9c18fbfc448da2eab551222252b7, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:24.383445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5a6afa-5159-4c38-bbeb-f124dc70bf44 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:24.459681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 550/1084] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:17:24 2022] PUT /identity/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5/users/bf7e9c18fbfc448da2eab551222252b7/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:17:26.572899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73375c6-0958-47b7-8671-8c08c8c2309c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:26.573487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73375c6-0958-47b7-8671-8c08c8c2309c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:26.573487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73375c6-0958-47b7-8671-8c08c8c2309c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:26.574834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 535/1085] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:26.580212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8db3e-644a-421d-a903-4e68e8f22524 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:26.580655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8db3e-644a-421d-a903-4e68e8f22524 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:26.580835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8db3e-644a-421d-a903-4e68e8f22524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:26.602623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-22a8db3e-644a-421d-a903-4e68e8f22524 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:26.603940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-22a8db3e-644a-421d-a903-4e68e8f22524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:26.658577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e349d-ee40-4156-b6ee-d5808d4bd602 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:26.658864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e349d-ee40-4156-b6ee-d5808d4bd602 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:26.659143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e349d-ee40-4156-b6ee-d5808d4bd602 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:26.661136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 536/1086] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:17:26.666222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef64ec-4760-4196-a016-629fab2c148c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:26.666508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef64ec-4760-4196-a016-629fab2c148c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:26.666788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef64ec-4760-4196-a016-629fab2c148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:26.672226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 551/1087] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:26.683478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-66ef64ec-4760-4196-a016-629fab2c148c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:26.684691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-66ef64ec-4760-4196-a016-629fab2c148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:26.696617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8db3e-644a-421d-a903-4e68e8f22524 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:26.727074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:26.755058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 537/1088] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:26.778905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef64ec-4760-4196-a016-629fab2c148c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:26.795594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8db3e-644a-421d-a903-4e68e8f22524 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:26.830125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4cd63-55cd-464e-8d12-36d568e0d65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:26.830864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4cd63-55cd-464e-8d12-36d568e0d65e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:26.831148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4cd63-55cd-464e-8d12-36d568e0d65e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:26.831423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc4cd63-55cd-464e-8d12-36d568e0d65e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:26.842506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc4cd63-55cd-464e-8d12-36d568e0d65e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6dc4cd63-55cd-464e-8d12-36d568e0d65e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:26.851318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:26.852601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:26.853920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 552/1089] 10.222.0.24 () {56 vars in 1120 bytes} [Wed May 25 07:17:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:26.858369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4cd63-55cd-464e-8d12-36d568e0d65e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:26.878046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef64ec-4760-4196-a016-629fab2c148c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:26.887262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:26.911207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc1025-2513-4183-9695-7a3e94f30f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:26.911991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc1025-2513-4183-9695-7a3e94f30f1a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:26.912268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc1025-2513-4183-9695-7a3e94f30f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:26.912572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc1025-2513-4183-9695-7a3e94f30f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:26.923381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc1025-2513-4183-9695-7a3e94f30f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-fccc1025-2513-4183-9695-7a3e94f30f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:26.931634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:26.932841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:26.933711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 538/1090] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:17:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:26.938752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc1025-2513-4183-9695-7a3e94f30f1a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:26.951313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:26.960331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc4cd63-55cd-464e-8d12-36d568e0d65e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:26.994419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258ecb2-053b-49e2-aed8-0ce5b05632a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:26.995087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258ecb2-053b-49e2-aed8-0ce5b05632a9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:26.995371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258ecb2-053b-49e2-aed8-0ce5b05632a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:26.995647 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5258ecb2-053b-49e2-aed8-0ce5b05632a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:26.996384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258ecb2-053b-49e2-aed8-0ce5b05632a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:26.996721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258ecb2-053b-49e2-aed8-0ce5b05632a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:26.998099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5258ecb2-053b-49e2-aed8-0ce5b05632a9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.006655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 553/1091] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 07:17:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:27.012323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258ecb2-053b-49e2-aed8-0ce5b05632a9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:27.038263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc1025-2513-4183-9695-7a3e94f30f1a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.071488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741b19c-9dfd-4570-b2b6-e224dd3a66c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.072143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741b19c-9dfd-4570-b2b6-e224dd3a66c9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.072422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741b19c-9dfd-4570-b2b6-e224dd3a66c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.072720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f741b19c-9dfd-4570-b2b6-e224dd3a66c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.073458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741b19c-9dfd-4570-b2b6-e224dd3a66c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:27.073996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741b19c-9dfd-4570-b2b6-e224dd3a66c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.075109 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f741b19c-9dfd-4570-b2b6-e224dd3a66c9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.083780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 539/1092] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:17:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:27.089537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741b19c-9dfd-4570-b2b6-e224dd3a66c9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:27.111132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5258ecb2-053b-49e2-aed8-0ce5b05632a9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.119042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:27.145219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a55f-888c-4675-99ef-485bac609271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.146005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a55f-888c-4675-99ef-485bac609271 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.146283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a55f-888c-4675-99ef-485bac609271 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.146554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3a55f-888c-4675-99ef-485bac609271 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.157550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3a55f-888c-4675-99ef-485bac609271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.159003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3a55f-888c-4675-99ef-485bac609271 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-6fc3a55f-888c-4675-99ef-485bac609271 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:27.176314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:27.177486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:27.178432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:27.178432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:27.178432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:27.178432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:27.178432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 554/1093] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:27.183252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a55f-888c-4675-99ef-485bac609271 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:27.188047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f741b19c-9dfd-4570-b2b6-e224dd3a66c9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.192612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:27.222408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3431-17df-40ef-83b4-3bd1606e33cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.223435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3431-17df-40ef-83b4-3bd1606e33cf None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.223721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3431-17df-40ef-83b4-3bd1606e33cf None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.223994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3431-17df-40ef-83b4-3bd1606e33cf None admin] PATH_INFO: `/v3/users/bf7e9c18fbfc448da2eab551222252b7` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.225226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd3431-17df-40ef-83b4-3bd1606e33cf None admin] RBAC: Authorizing `identity:get_user(user_id=bf7e9c18fbfc448da2eab551222252b7)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.226687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd3431-17df-40ef-83b4-3bd1606e33cf None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.228327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 540/1094] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:27 2022] GET /identity/v3/users/bf7e9c18fbfc448da2eab551222252b7 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:27.234066 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3431-17df-40ef-83b4-3bd1606e33cf None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:27.286884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3a55f-888c-4675-99ef-485bac609271 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.320318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167868e-8cb1-426b-86e2-8cff5fbc6a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.321002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167868e-8cb1-426b-86e2-8cff5fbc6a79 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.321285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167868e-8cb1-426b-86e2-8cff5fbc6a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.321562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167868e-8cb1-426b-86e2-8cff5fbc6a79 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.322284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167868e-8cb1-426b-86e2-8cff5fbc6a79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:27.322590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167868e-8cb1-426b-86e2-8cff5fbc6a79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.323970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6167868e-8cb1-426b-86e2-8cff5fbc6a79 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.330638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:27.335115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3431-17df-40ef-83b4-3bd1606e33cf None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.336873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 555/1095] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:27.342329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167868e-8cb1-426b-86e2-8cff5fbc6a79 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:27.370331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6ec90-f20a-4525-a5fe-b1d9fb44554e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.370982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6ec90-f20a-4525-a5fe-b1d9fb44554e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.371318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6ec90-f20a-4525-a5fe-b1d9fb44554e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.371779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6ec90-f20a-4525-a5fe-b1d9fb44554e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.406723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:27.500555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167868e-8cb1-426b-86e2-8cff5fbc6a79 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.505828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6ec90-f20a-4525-a5fe-b1d9fb44554e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.507304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6ec90-f20a-4525-a5fe-b1d9fb44554e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.535311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba3a6d-5885-4d52-adbd-dbc2f81cd3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.536111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3a6d-5885-4d52-adbd-dbc2f81cd3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.536392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3a6d-5885-4d52-adbd-dbc2f81cd3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.536703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba3a6d-5885-4d52-adbd-dbc2f81cd3e7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.543630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba3a6d-5885-4d52-adbd-dbc2f81cd3e7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.545134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba3a6d-5885-4d52-adbd-dbc2f81cd3e7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-61ba3a6d-5885-4d52-adbd-dbc2f81cd3e7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:17:27.560596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:27.561572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:17:27.562689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:27.564805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 556/1096] 10.222.0.24 () {56 vars in 1093 bytes} [Wed May 25 07:17:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:27.567614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba3a6d-5885-4d52-adbd-dbc2f81cd3e7 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:27.603627 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:27.608230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 541/1097] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 07:17:27.614978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6ec90-f20a-4525-a5fe-b1d9fb44554e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:27.671935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba3a6d-5885-4d52-adbd-dbc2f81cd3e7 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.697312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:27.706227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd781d8-ca5c-4c8c-8f64-570a910d9900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.711604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd781d8-ca5c-4c8c-8f64-570a910d9900 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.711604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd781d8-ca5c-4c8c-8f64-570a910d9900 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.711604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd781d8-ca5c-4c8c-8f64-570a910d9900 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.711604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd781d8-ca5c-4c8c-8f64-570a910d9900 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:27.711604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd781d8-ca5c-4c8c-8f64-570a910d9900 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.711604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd781d8-ca5c-4c8c-8f64-570a910d9900 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.713244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6ec90-f20a-4525-a5fe-b1d9fb44554e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.728010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 557/1098] 10.222.0.24 () {56 vars in 1133 bytes} [Wed May 25 07:17:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:27.733741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd781d8-ca5c-4c8c-8f64-570a910d9900 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:27.748888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf0878-a7c2-479c-9ad2-7aacea1b5106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.749846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf0878-a7c2-479c-9ad2-7aacea1b5106 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.750135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf0878-a7c2-479c-9ad2-7aacea1b5106 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.750414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf0878-a7c2-479c-9ad2-7aacea1b5106 None admin] PATH_INFO: `/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.751590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf0878-a7c2-479c-9ad2-7aacea1b5106 None admin] RBAC: Authorizing `identity:get_project(project_id=89470cdcd8b14aa387b6492fb6ba24a5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.753062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf0878-a7c2-479c-9ad2-7aacea1b5106 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.754828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 542/1099] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:17:27 2022] GET /identity/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:27.760776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf0878-a7c2-479c-9ad2-7aacea1b5106 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:27.827131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:27.834134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd781d8-ca5c-4c8c-8f64-570a910d9900 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.878163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf0878-a7c2-479c-9ad2-7aacea1b5106 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:27.879842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fc3d5-caca-4aab-98c2-8ded2d758e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.880677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc3d5-caca-4aab-98c2-8ded2d758e78 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.881136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc3d5-caca-4aab-98c2-8ded2d758e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.881605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77fc3d5-caca-4aab-98c2-8ded2d758e78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.912562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062f23-f9b2-4195-9d52-a5683f23e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:27.913217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062f23-f9b2-4195-9d52-a5683f23e181 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:27.913502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062f23-f9b2-4195-9d52-a5683f23e181 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:27.913782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30062f23-f9b2-4195-9d52-a5683f23e181 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:27.914619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062f23-f9b2-4195-9d52-a5683f23e181 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=89470cdcd8b14aa387b6492fb6ba24a5, user.id=bf7e9c18fbfc448da2eab551222252b7) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:27.914935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062f23-f9b2-4195-9d52-a5683f23e181 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.916368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30062f23-f9b2-4195-9d52-a5683f23e181 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:27.922193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 543/1100] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:17:27 2022] GET /identity/v3/role_assignments?user.id=bf7e9c18fbfc448da2eab551222252b7&scope.project.id=89470cdcd8b14aa387b6492fb6ba24a5&role.id=7c09d078126441909df0a46212ffea63 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:27.933538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:27.950837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fc3d5-caca-4aab-98c2-8ded2d758e78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:27.952338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77fc3d5-caca-4aab-98c2-8ded2d758e78 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:28.061753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 558/1101] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 07:17:28.062956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062f23-f9b2-4195-9d52-a5683f23e181 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:28.165342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30062f23-f9b2-4195-9d52-a5683f23e181 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:28.193622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:28.198951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e817bd-70f5-486b-bdca-a37914e71cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:28.199741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e817bd-70f5-486b-bdca-a37914e71cfd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:28.200024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e817bd-70f5-486b-bdca-a37914e71cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:28.200299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e817bd-70f5-486b-bdca-a37914e71cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:28.210747 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e817bd-70f5-486b-bdca-a37914e71cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:28.212189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e817bd-70f5-486b-bdca-a37914e71cfd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-99e817bd-70f5-486b-bdca-a37914e71cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:28.230333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:28.235216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:28.236120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:17:28.236120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:28.236120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:17:28.236120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:28.236120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 544/1102] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:17:28.237982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fc3d5-caca-4aab-98c2-8ded2d758e78 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:28.321634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:28.336914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77fc3d5-caca-4aab-98c2-8ded2d758e78 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:28.371133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c0a5e-f1ef-4df2-989a-62850d0fab9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:28.371820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c0a5e-f1ef-4df2-989a-62850d0fab9c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:28.372106 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c0a5e-f1ef-4df2-989a-62850d0fab9c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:28.372384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0c0a5e-f1ef-4df2-989a-62850d0fab9c None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:28.373143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c0a5e-f1ef-4df2-989a-62850d0fab9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:28.373452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c0a5e-f1ef-4df2-989a-62850d0fab9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:28.374851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0c0a5e-f1ef-4df2-989a-62850d0fab9c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:28.386523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 559/1103] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:28.392834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e817bd-70f5-486b-bdca-a37914e71cfd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:28.490869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e817bd-70f5-486b-bdca-a37914e71cfd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:28.523831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df417b9-acee-4c25-8baf-8e857a0dfcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:28.524648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df417b9-acee-4c25-8baf-8e857a0dfcfb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:28.524938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df417b9-acee-4c25-8baf-8e857a0dfcfb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:28.525219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df417b9-acee-4c25-8baf-8e857a0dfcfb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:28.531801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df417b9-acee-4c25-8baf-8e857a0dfcfb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:28.533256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df417b9-acee-4c25-8baf-8e857a0dfcfb None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-3df417b9-acee-4c25-8baf-8e857a0dfcfb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:17:28.547980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:28.549154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:28.550350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:17:28.550350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:17:28.550350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:17:28.550350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:17:28.550350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:17:28.550350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:17:28.550350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:17:28.550350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:28.550350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 545/1104] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:17:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:28.555037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c0a5e-f1ef-4df2-989a-62850d0fab9c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:28.657123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0c0a5e-f1ef-4df2-989a-62850d0fab9c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:28.690397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceefd122-ed43-4461-a04b-4f3ba4e5cfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:28.691129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefd122-ed43-4461-a04b-4f3ba4e5cfc0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:28.691471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefd122-ed43-4461-a04b-4f3ba4e5cfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:28.691748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceefd122-ed43-4461-a04b-4f3ba4e5cfc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:28.692558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefd122-ed43-4461-a04b-4f3ba4e5cfc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:28.692863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefd122-ed43-4461-a04b-4f3ba4e5cfc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:28.694290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceefd122-ed43-4461-a04b-4f3ba4e5cfc0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:28.705992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 560/1105] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:17:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:28.712846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df417b9-acee-4c25-8baf-8e857a0dfcfb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:28.757680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:28.811769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df417b9-acee-4c25-8baf-8e857a0dfcfb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:28.846348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6f5ce-3630-4389-b9e2-9f5f2a726799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:28.847031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6f5ce-3630-4389-b9e2-9f5f2a726799 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:28.847399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6f5ce-3630-4389-b9e2-9f5f2a726799 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:28.847682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6f5ce-3630-4389-b9e2-9f5f2a726799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:28.848541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6f5ce-3630-4389-b9e2-9f5f2a726799 None admin] RBAC: Adding query filter params (role.id=04321844426a44e5b76b8c33ef3363a2, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=3a06a84967694e68a3a77bf29f16ee3b) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:28.848859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6f5ce-3630-4389-b9e2-9f5f2a726799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:28.850282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f6f5ce-3630-4389-b9e2-9f5f2a726799 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:28.856223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 546/1106] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:17:28 2022] GET /identity/v3/role_assignments?user.id=3a06a84967694e68a3a77bf29f16ee3b&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=04321844426a44e5b76b8c33ef3363a2 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:30.161320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc044c8-cdb6-474f-b1f5-4019ee4c07ab None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:30.161868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc044c8-cdb6-474f-b1f5-4019ee4c07ab None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:30.161868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc044c8-cdb6-474f-b1f5-4019ee4c07ab None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:30.163219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 561/1107] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:30.168541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a41f-2095-4b7e-8905-c45152bb732b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:30.168964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a41f-2095-4b7e-8905-c45152bb732b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:30.169105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e0a41f-2095-4b7e-8905-c45152bb732b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:30.186177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d7e0a41f-2095-4b7e-8905-c45152bb732b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:30.187390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d7e0a41f-2095-4b7e-8905-c45152bb732b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:30.254421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 547/1108] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:30.278869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc044c8-cdb6-474f-b1f5-4019ee4c07ab None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:30.282791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:30.377016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc044c8-cdb6-474f-b1f5-4019ee4c07ab None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:30.409403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612a280-365c-4c0f-ab18-dc55a517dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:30.410276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a280-365c-4c0f-ab18-dc55a517dca3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:30.410553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a280-365c-4c0f-ab18-dc55a517dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:30.410818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a280-365c-4c0f-ab18-dc55a517dca3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:30.412017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612a280-365c-4c0f-ab18-dc55a517dca3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:30.413413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6612a280-365c-4c0f-ab18-dc55a517dca3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:30.414978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 562/1109] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:30.420617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0a41f-2095-4b7e-8905-c45152bb732b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:30.455167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:30.518490 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e0a41f-2095-4b7e-8905-c45152bb732b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:30.552097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ba5e9-b732-43c2-8200-cb1b2678ba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:30.552785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ba5e9-b732-43c2-8200-cb1b2678ba2c None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:30.553072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ba5e9-b732-43c2-8200-cb1b2678ba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:30.553352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ba5e9-b732-43c2-8200-cb1b2678ba2c None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:30.554069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ba5e9-b732-43c2-8200-cb1b2678ba2c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:30.555498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ba5e9-b732-43c2-8200-cb1b2678ba2c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:30.637797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 548/1110] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:17:30 2022] POST /identity/v3/users => generated 286 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:17:32.860714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64693b-5255-4b55-8f5e-08dcc277ee10 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:32.861213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64693b-5255-4b55-8f5e-08dcc277ee10 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:32.861213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b64693b-5255-4b55-8f5e-08dcc277ee10 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:32.862545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 563/1111] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:32.868412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f783274-af26-43e0-b4e7-e6b60326e796 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:32.868843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f783274-af26-43e0-b4e7-e6b60326e796 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:32.868995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f783274-af26-43e0-b4e7-e6b60326e796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:32.885561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6f783274-af26-43e0-b4e7-e6b60326e796 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:32.886723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6f783274-af26-43e0-b4e7-e6b60326e796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:32.950997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 549/1112] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:32.975035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64693b-5255-4b55-8f5e-08dcc277ee10 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:33.045455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:33.074353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b64693b-5255-4b55-8f5e-08dcc277ee10 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:33.108190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70d03d-3aa1-4055-b2ac-5d86de4bbfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:33.109062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70d03d-3aa1-4055-b2ac-5d86de4bbfd1 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:33.109340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70d03d-3aa1-4055-b2ac-5d86de4bbfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:33.109606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70d03d-3aa1-4055-b2ac-5d86de4bbfd1 None admin] PATH_INFO: `/v3/roles/3e26988f292a493c8351b566b43239e2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:33.111095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70d03d-3aa1-4055-b2ac-5d86de4bbfd1 None admin] RBAC: Authorizing `identity:get_role(role_id=3e26988f292a493c8351b566b43239e2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:33.112422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70d03d-3aa1-4055-b2ac-5d86de4bbfd1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:33.114037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 564/1113] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:32 2022] GET /identity/v3/roles/3e26988f292a493c8351b566b43239e2 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:33.119827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f783274-af26-43e0-b4e7-e6b60326e796 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:33.142801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:33.215593 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f783274-af26-43e0-b4e7-e6b60326e796 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:33.249412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eaacb-2f6f-40a6-8c30-a534de006d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:33.250264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eaacb-2f6f-40a6-8c30-a534de006d12 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:33.250543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eaacb-2f6f-40a6-8c30-a534de006d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:33.250896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eaacb-2f6f-40a6-8c30-a534de006d12 None admin] PATH_INFO: `/v3/users/212c0550edad42cb80f600e0ec1b0fb4` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:33.264156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eaacb-2f6f-40a6-8c30-a534de006d12 None admin] RBAC: Authorizing `identity:get_user(user_id=212c0550edad42cb80f600e0ec1b0fb4)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:33.265618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eaacb-2f6f-40a6-8c30-a534de006d12 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:33.267237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 550/1114] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:33 2022] GET /identity/v3/users/212c0550edad42cb80f600e0ec1b0fb4 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:33.273146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70d03d-3aa1-4055-b2ac-5d86de4bbfd1 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:33.370629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70d03d-3aa1-4055-b2ac-5d86de4bbfd1 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:33.403154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69c6a-d275-4d27-aa62-1c47f4b0e1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:33.403783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69c6a-d275-4d27-aa62-1c47f4b0e1da None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:33.404059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69c6a-d275-4d27-aa62-1c47f4b0e1da None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:33.404328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe69c6a-d275-4d27-aa62-1c47f4b0e1da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:33.414289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:33.469092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe69c6a-d275-4d27-aa62-1c47f4b0e1da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:33.470556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe69c6a-d275-4d27-aa62-1c47f4b0e1da None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:33.566757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 565/1115] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:17:33.572661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eaacb-2f6f-40a6-8c30-a534de006d12 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:33.653378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:33.671658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eaacb-2f6f-40a6-8c30-a534de006d12 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:33.704945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a217a-9828-44e7-8f8c-f3755f4a9337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:33.705795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a217a-9828-44e7-8f8c-f3755f4a9337 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:33.706079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a217a-9828-44e7-8f8c-f3755f4a9337 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:33.706996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a217a-9828-44e7-8f8c-f3755f4a9337 None admin] PATH_INFO: `/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:33.708858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a217a-9828-44e7-8f8c-f3755f4a9337 None admin] RBAC: Authorizing `identity:get_project(project_id=89470cdcd8b14aa387b6492fb6ba24a5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:33.710908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a217a-9828-44e7-8f8c-f3755f4a9337 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:33.712622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 551/1116] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:17:33 2022] GET /identity/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:33.719025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69c6a-d275-4d27-aa62-1c47f4b0e1da None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:33.759821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:33.816152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe69c6a-d275-4d27-aa62-1c47f4b0e1da None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:33.849802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1045b57a-234a-4a3b-9b9a-912e04e48f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:33.850435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045b57a-234a-4a3b-9b9a-912e04e48f2a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:33.850714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045b57a-234a-4a3b-9b9a-912e04e48f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:33.850986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1045b57a-234a-4a3b-9b9a-912e04e48f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:33.851797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045b57a-234a-4a3b-9b9a-912e04e48f2a None admin] RBAC: Adding query filter params (role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=89470cdcd8b14aa387b6492fb6ba24a5, user.id=212c0550edad42cb80f600e0ec1b0fb4) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:33.852105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045b57a-234a-4a3b-9b9a-912e04e48f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:33.853635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1045b57a-234a-4a3b-9b9a-912e04e48f2a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:33.858891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 566/1117] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:17:33 2022] GET /identity/v3/role_assignments?user.id=212c0550edad42cb80f600e0ec1b0fb4&scope.project.id=89470cdcd8b14aa387b6492fb6ba24a5&role.id=3e26988f292a493c8351b566b43239e2 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:35.992724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3382-54e3-4477-b069-2534dd4e657c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:35.993257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3382-54e3-4477-b069-2534dd4e657c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:35.993257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a3382-54e3-4477-b069-2534dd4e657c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:35.994621 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 552/1118] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:35.999761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359cd0d-9811-4575-9844-bca0220985c1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:36.000148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359cd0d-9811-4575-9844-bca0220985c1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:36.000314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359cd0d-9811-4575-9844-bca0220985c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:36.016806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5359cd0d-9811-4575-9844-bca0220985c1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:36.017991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5359cd0d-9811-4575-9844-bca0220985c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:36.083088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 567/1119] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:17:36.105862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a3382-54e3-4477-b069-2534dd4e657c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:36.202329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a3382-54e3-4477-b069-2534dd4e657c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:36.235591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d38a0-639a-4c8c-b2bb-02514402c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:36.236427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d38a0-639a-4c8c-b2bb-02514402c732 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:36.236735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d38a0-639a-4c8c-b2bb-02514402c732 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:36.237006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d38a0-639a-4c8c-b2bb-02514402c732 None admin] PATH_INFO: `/v3/roles/3e26988f292a493c8351b566b43239e2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:36.239043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d38a0-639a-4c8c-b2bb-02514402c732 None admin] RBAC: Authorizing `identity:get_role(role_id=3e26988f292a493c8351b566b43239e2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:36.240393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d38a0-639a-4c8c-b2bb-02514402c732 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:36.241766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 553/1120] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:36 2022] GET /identity/v3/roles/3e26988f292a493c8351b566b43239e2 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:36.247513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359cd0d-9811-4575-9844-bca0220985c1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:36.280119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:36.344397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359cd0d-9811-4575-9844-bca0220985c1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:36.377742 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3af288-73fb-481f-892f-7720e9a1acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:36.379315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3af288-73fb-481f-892f-7720e9a1acb2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:36.379596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3af288-73fb-481f-892f-7720e9a1acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:36.379874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3af288-73fb-481f-892f-7720e9a1acb2 None admin] PATH_INFO: `/v3/users/212c0550edad42cb80f600e0ec1b0fb4` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:36.381086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3af288-73fb-481f-892f-7720e9a1acb2 None admin] RBAC: Authorizing `identity:get_user(user_id=212c0550edad42cb80f600e0ec1b0fb4)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:36.382562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3af288-73fb-481f-892f-7720e9a1acb2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:36.384180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 568/1121] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:36 2022] GET /identity/v3/users/212c0550edad42cb80f600e0ec1b0fb4 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:36.389962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d38a0-639a-4c8c-b2bb-02514402c732 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:36.407903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:36.489465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d38a0-639a-4c8c-b2bb-02514402c732 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:36.522405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59c090-2294-44e8-b6ec-d05537218263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:36.523199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c090-2294-44e8-b6ec-d05537218263 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:36.523482 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c090-2294-44e8-b6ec-d05537218263 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:36.523754 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c090-2294-44e8-b6ec-d05537218263 None admin] PATH_INFO: `/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:36.524970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59c090-2294-44e8-b6ec-d05537218263 None admin] RBAC: Authorizing `identity:get_project(project_id=89470cdcd8b14aa387b6492fb6ba24a5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:36.526395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59c090-2294-44e8-b6ec-d05537218263 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:36.528074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 554/1122] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:17:36 2022] GET /identity/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:36.534053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3af288-73fb-481f-892f-7720e9a1acb2 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:36.630314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3af288-73fb-481f-892f-7720e9a1acb2 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:36.631816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:36.664737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d675b1-a876-4d21-b5c0-326a2c9b7d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:36.665608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d675b1-a876-4d21-b5c0-326a2c9b7d16 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:36.665887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d675b1-a876-4d21-b5c0-326a2c9b7d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:36.666164 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d675b1-a876-4d21-b5c0-326a2c9b7d16 None admin] PATH_INFO: `/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5/users/212c0550edad42cb80f600e0ec1b0fb4/roles/3e26988f292a493c8351b566b43239e2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:36.668328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d675b1-a876-4d21-b5c0-326a2c9b7d16 None admin] RBAC: Authorizing `identity:create_grant(project_id=89470cdcd8b14aa387b6492fb6ba24a5, user_id=212c0550edad42cb80f600e0ec1b0fb4, role_id=3e26988f292a493c8351b566b43239e2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:36.669806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d675b1-a876-4d21-b5c0-326a2c9b7d16 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:36.777236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 569/1123] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:17:36 2022] PUT /identity/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5/users/212c0550edad42cb80f600e0ec1b0fb4/roles/3e26988f292a493c8351b566b43239e2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:17:38.936934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a43b7-8f22-4076-a49d-e8fa11193881 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:38.937431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a43b7-8f22-4076-a49d-e8fa11193881 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:38.937431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a43b7-8f22-4076-a49d-e8fa11193881 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:38.938764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 555/1124] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:38.944887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e1680-483d-4679-a406-7e2cb49a0226 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:38.945284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e1680-483d-4679-a406-7e2cb49a0226 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:38.945447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e1680-483d-4679-a406-7e2cb49a0226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:38.962100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ab8e1680-483d-4679-a406-7e2cb49a0226 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:38.963287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ab8e1680-483d-4679-a406-7e2cb49a0226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:39.028990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 570/1125] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:39.052015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a43b7-8f22-4076-a49d-e8fa11193881 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:39.135656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:39.152507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a43b7-8f22-4076-a49d-e8fa11193881 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:39.188459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d244-aed8-43dd-92b1-aaf43cccb1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:39.189272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d244-aed8-43dd-92b1-aaf43cccb1c9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:39.189550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d244-aed8-43dd-92b1-aaf43cccb1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:39.189821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e71d244-aed8-43dd-92b1-aaf43cccb1c9 None admin] PATH_INFO: `/v3/roles/3e26988f292a493c8351b566b43239e2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:39.193144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d244-aed8-43dd-92b1-aaf43cccb1c9 None admin] RBAC: Authorizing `identity:get_role(role_id=3e26988f292a493c8351b566b43239e2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:39.194517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e71d244-aed8-43dd-92b1-aaf43cccb1c9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:39.195887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 556/1126] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:39 2022] GET /identity/v3/roles/3e26988f292a493c8351b566b43239e2 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:39.201645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e1680-483d-4679-a406-7e2cb49a0226 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:39.288254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:39.296319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e1680-483d-4679-a406-7e2cb49a0226 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:39.329076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727d3e-73c7-4b87-853d-96a7115d50ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:39.333921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727d3e-73c7-4b87-853d-96a7115d50ef None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:39.333921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727d3e-73c7-4b87-853d-96a7115d50ef None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:39.333921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d727d3e-73c7-4b87-853d-96a7115d50ef None admin] PATH_INFO: `/v3/users/212c0550edad42cb80f600e0ec1b0fb4` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:39.333921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d727d3e-73c7-4b87-853d-96a7115d50ef None admin] RBAC: Authorizing `identity:get_user(user_id=212c0550edad42cb80f600e0ec1b0fb4)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:39.333921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d727d3e-73c7-4b87-853d-96a7115d50ef None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:39.334808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 571/1127] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:39 2022] GET /identity/v3/users/212c0550edad42cb80f600e0ec1b0fb4 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:39.340537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d244-aed8-43dd-92b1-aaf43cccb1c9 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:39.439060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e71d244-aed8-43dd-92b1-aaf43cccb1c9 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:39.473098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372745b-3052-48b2-876d-1ff48889e684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:39.473745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372745b-3052-48b2-876d-1ff48889e684 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:39.474029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372745b-3052-48b2-876d-1ff48889e684 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:39.474305 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7372745b-3052-48b2-876d-1ff48889e684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:39.495414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:39.541684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372745b-3052-48b2-876d-1ff48889e684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:39.543139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7372745b-3052-48b2-876d-1ff48889e684 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:39.640770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 557/1128] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:17:39.646630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727d3e-73c7-4b87-853d-96a7115d50ef None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:39.745294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d727d3e-73c7-4b87-853d-96a7115d50ef None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:39.778252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a1cf87-63af-4f1b-891a-1bdac11d5e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:39.779098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1cf87-63af-4f1b-891a-1bdac11d5e17 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:39.779381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1cf87-63af-4f1b-891a-1bdac11d5e17 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:39.779657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a1cf87-63af-4f1b-891a-1bdac11d5e17 None admin] PATH_INFO: `/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:39.780850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1cf87-63af-4f1b-891a-1bdac11d5e17 None admin] RBAC: Authorizing `identity:get_project(project_id=89470cdcd8b14aa387b6492fb6ba24a5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:39.782320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a1cf87-63af-4f1b-891a-1bdac11d5e17 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:39.783991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 572/1129] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:17:39 2022] GET /identity/v3/projects/89470cdcd8b14aa387b6492fb6ba24a5 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:39.790462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372745b-3052-48b2-876d-1ff48889e684 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:39.842091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:39.886418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7372745b-3052-48b2-876d-1ff48889e684 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:39.919692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda261-3950-45a9-82eb-94cff4a66209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:39.920331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda261-3950-45a9-82eb-94cff4a66209 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:39.920640 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda261-3950-45a9-82eb-94cff4a66209 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:39.920919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda261-3950-45a9-82eb-94cff4a66209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:39.921737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda261-3950-45a9-82eb-94cff4a66209 None admin] RBAC: Adding query filter params (role.id=3e26988f292a493c8351b566b43239e2, scope.project.id=89470cdcd8b14aa387b6492fb6ba24a5, user.id=212c0550edad42cb80f600e0ec1b0fb4) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:39.922044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda261-3950-45a9-82eb-94cff4a66209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:39.923458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda261-3950-45a9-82eb-94cff4a66209 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:39.929331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 558/1130] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:17:39 2022] GET /identity/v3/role_assignments?user.id=212c0550edad42cb80f600e0ec1b0fb4&scope.project.id=89470cdcd8b14aa387b6492fb6ba24a5&role.id=3e26988f292a493c8351b566b43239e2 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:17:42.108336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2d36-b393-4742-8be3-4019cd27dd4e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:42.108916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2d36-b393-4742-8be3-4019cd27dd4e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:42.108916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6d2d36-b393-4742-8be3-4019cd27dd4e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:42.110293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 573/1131] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:42.115989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee692d-3cf0-46ad-ad97-6a063eca6789 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:42.116414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee692d-3cf0-46ad-ad97-6a063eca6789 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:42.116574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fee692d-3cf0-46ad-ad97-6a063eca6789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:42.133455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0fee692d-3cf0-46ad-ad97-6a063eca6789 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:42.134619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0fee692d-3cf0-46ad-ad97-6a063eca6789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:42.199491 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 559/1132] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:42.222355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d2d36-b393-4742-8be3-4019cd27dd4e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:42.249849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:42.321633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6d2d36-b393-4742-8be3-4019cd27dd4e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:42.353632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc2165-69de-4ecc-881b-8ff6494df4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:42.354409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc2165-69de-4ecc-881b-8ff6494df4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:42.354690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc2165-69de-4ecc-881b-8ff6494df4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:42.354965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc2165-69de-4ecc-881b-8ff6494df4d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:42.356133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc2165-69de-4ecc-881b-8ff6494df4d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:42.357589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc2165-69de-4ecc-881b-8ff6494df4d9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:42.359221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 574/1133] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:42.365777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee692d-3cf0-46ad-ad97-6a063eca6789 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:42.411381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:42.461331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fee692d-3cf0-46ad-ad97-6a063eca6789 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:42.495650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210ca2a-9810-4765-b8a6-05c5cccce470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:42.496301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ca2a-9810-4765-b8a6-05c5cccce470 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:42.496620 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ca2a-9810-4765-b8a6-05c5cccce470 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:42.496896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210ca2a-9810-4765-b8a6-05c5cccce470 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:42.497598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210ca2a-9810-4765-b8a6-05c5cccce470 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:42.499027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210ca2a-9810-4765-b8a6-05c5cccce470 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:42.593474 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 560/1134] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:17:42 2022] POST /identity/v3/projects => generated 311 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:17:44.802579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5001a8-bfbf-4bcc-9b22-704de09dc754 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:44.803125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5001a8-bfbf-4bcc-9b22-704de09dc754 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:44.803125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5001a8-bfbf-4bcc-9b22-704de09dc754 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:44.804502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 575/1135] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:44.809696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811c198-a63b-4573-80a3-0bb6a7bf5d7a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:44.810134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811c198-a63b-4573-80a3-0bb6a7bf5d7a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:44.810251 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811c198-a63b-4573-80a3-0bb6a7bf5d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:44.827023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7811c198-a63b-4573-80a3-0bb6a7bf5d7a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:44.828197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7811c198-a63b-4573-80a3-0bb6a7bf5d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:44.892468 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 561/1136] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:44.917433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5001a8-bfbf-4bcc-9b22-704de09dc754 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:45.008442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:45.014810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5001a8-bfbf-4bcc-9b22-704de09dc754 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:45.048171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f44fec9-2332-48e1-ae41-bfc948727921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:45.048975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44fec9-2332-48e1-ae41-bfc948727921 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:45.049253 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44fec9-2332-48e1-ae41-bfc948727921 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:45.049547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f44fec9-2332-48e1-ae41-bfc948727921 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:45.050707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44fec9-2332-48e1-ae41-bfc948727921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:45.052127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f44fec9-2332-48e1-ae41-bfc948727921 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:45.053730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 576/1137] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:17:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:45.059350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811c198-a63b-4573-80a3-0bb6a7bf5d7a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:45.086977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:45.156895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811c198-a63b-4573-80a3-0bb6a7bf5d7a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:45.189353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f1adff-70f9-49b1-b4bb-4225d27cc851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:45.190011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1adff-70f9-49b1-b4bb-4225d27cc851 None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:45.190849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1adff-70f9-49b1-b4bb-4225d27cc851 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:45.191123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f1adff-70f9-49b1-b4bb-4225d27cc851 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:45.191823 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1adff-70f9-49b1-b4bb-4225d27cc851 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:45.193273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f1adff-70f9-49b1-b4bb-4225d27cc851 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:45.271801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 562/1138] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:17:45 2022] POST /identity/v3/users => generated 286 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:17:47.505962 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4b5c-03cc-49c4-b3b8-49b0125468f5 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:47.506499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4b5c-03cc-49c4-b3b8-49b0125468f5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:47.506499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa4b5c-03cc-49c4-b3b8-49b0125468f5 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:47.507854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 577/1139] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:47.513186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05f5da-6714-4b78-a17e-1b3933f5f282 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:47.513589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05f5da-6714-4b78-a17e-1b3933f5f282 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:47.513744 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05f5da-6714-4b78-a17e-1b3933f5f282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:47.530405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5f05f5da-6714-4b78-a17e-1b3933f5f282 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:47.531594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5f05f5da-6714-4b78-a17e-1b3933f5f282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:47.598594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 563/1140] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:47.623314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4b5c-03cc-49c4-b3b8-49b0125468f5 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:47.720746 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa4b5c-03cc-49c4-b3b8-49b0125468f5 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:47.754566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24d3e3-3e19-4afe-a7cc-173523b1b667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:47.755338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24d3e3-3e19-4afe-a7cc-173523b1b667 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:47.755615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24d3e3-3e19-4afe-a7cc-173523b1b667 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:47.755884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f24d3e3-3e19-4afe-a7cc-173523b1b667 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:47.765615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f24d3e3-3e19-4afe-a7cc-173523b1b667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-9f24d3e3-3e19-4afe-a7cc-173523b1b667 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:47.773366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:47.774533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:47.775660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 578/1141] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:17:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:47.780656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05f5da-6714-4b78-a17e-1b3933f5f282 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:47.795678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:47.879598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05f5da-6714-4b78-a17e-1b3933f5f282 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:47.917594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a345bf-ce2f-43b7-b505-d41f110d27e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:47.918271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a345bf-ce2f-43b7-b505-d41f110d27e8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:47.918529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a345bf-ce2f-43b7-b505-d41f110d27e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:47.918803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a345bf-ce2f-43b7-b505-d41f110d27e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:47.919544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a345bf-ce2f-43b7-b505-d41f110d27e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:47.919850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a345bf-ce2f-43b7-b505-d41f110d27e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:47.921329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a345bf-ce2f-43b7-b505-d41f110d27e8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:47.929994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 564/1142] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:17:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:47.935702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24d3e3-3e19-4afe-a7cc-173523b1b667 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:47.960808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:48.031893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f24d3e3-3e19-4afe-a7cc-173523b1b667 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:48.064306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727baea5-ca1c-467d-b702-a3c038f2ccb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:48.065185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727baea5-ca1c-467d-b702-a3c038f2ccb0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:48.065469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727baea5-ca1c-467d-b702-a3c038f2ccb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:48.065743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727baea5-ca1c-467d-b702-a3c038f2ccb0 None admin] PATH_INFO: `/v3/users/0cc8363a4b28494086de558b8a049578` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:48.078306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727baea5-ca1c-467d-b702-a3c038f2ccb0 None admin] RBAC: Authorizing `identity:get_user(user_id=0cc8363a4b28494086de558b8a049578)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:48.079755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727baea5-ca1c-467d-b702-a3c038f2ccb0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:48.081401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 579/1143] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:47 2022] GET /identity/v3/users/0cc8363a4b28494086de558b8a049578 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:48.087732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a345bf-ce2f-43b7-b505-d41f110d27e8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:48.162387 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:48.183786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a345bf-ce2f-43b7-b505-d41f110d27e8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:48.216198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15fb7f-566f-4d91-a9d9-3e49986ced75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:48.217130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15fb7f-566f-4d91-a9d9-3e49986ced75 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:48.217413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15fb7f-566f-4d91-a9d9-3e49986ced75 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:48.217688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15fb7f-566f-4d91-a9d9-3e49986ced75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:48.283932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15fb7f-566f-4d91-a9d9-3e49986ced75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:48.286048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b15fb7f-566f-4d91-a9d9-3e49986ced75 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:48.358329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:48.380410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 565/1144] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:17:48.386338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727baea5-ca1c-467d-b702-a3c038f2ccb0 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:48.463870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:48.481519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727baea5-ca1c-467d-b702-a3c038f2ccb0 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:48.514097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2151a4-f583-4021-9e60-3fe8fbc763bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:48.514945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2151a4-f583-4021-9e60-3fe8fbc763bb None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:48.515226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2151a4-f583-4021-9e60-3fe8fbc763bb None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:48.515500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2151a4-f583-4021-9e60-3fe8fbc763bb None admin] PATH_INFO: `/v3/projects/0359d85dcd49406da4f2ecc2b8822fea` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:48.516684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2151a4-f583-4021-9e60-3fe8fbc763bb None admin] RBAC: Authorizing `identity:get_project(project_id=0359d85dcd49406da4f2ecc2b8822fea)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:48.518127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2151a4-f583-4021-9e60-3fe8fbc763bb None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:48.520047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 580/1145] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:17:48 2022] GET /identity/v3/projects/0359d85dcd49406da4f2ecc2b8822fea => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:48.525971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15fb7f-566f-4d91-a9d9-3e49986ced75 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:48.622117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15fb7f-566f-4d91-a9d9-3e49986ced75 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:48.654211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90ae821-f1a8-46c8-8f6b-11c5e88b90ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:48.654848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ae821-f1a8-46c8-8f6b-11c5e88b90ec None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:48.655126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ae821-f1a8-46c8-8f6b-11c5e88b90ec None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:48.655397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90ae821-f1a8-46c8-8f6b-11c5e88b90ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:48.656219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ae821-f1a8-46c8-8f6b-11c5e88b90ec None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=0359d85dcd49406da4f2ecc2b8822fea, user.id=0cc8363a4b28494086de558b8a049578) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:48.656554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ae821-f1a8-46c8-8f6b-11c5e88b90ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:48.657971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90ae821-f1a8-46c8-8f6b-11c5e88b90ec None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:48.663886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 566/1146] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:17:48 2022] GET /identity/v3/role_assignments?user.id=0cc8363a4b28494086de558b8a049578&scope.project.id=0359d85dcd49406da4f2ecc2b8822fea&role.id=7c09d078126441909df0a46212ffea63 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:50.837159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f4acd-8060-4e36-9479-9f43660d9481 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:50.837720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f4acd-8060-4e36-9479-9f43660d9481 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:50.837720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f4acd-8060-4e36-9479-9f43660d9481 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:50.839078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 581/1147] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:50.844885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1286abf-4141-4a6e-8fb7-f389702e88f8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:50.845272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1286abf-4141-4a6e-8fb7-f389702e88f8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:50.845375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1286abf-4141-4a6e-8fb7-f389702e88f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:50.862298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b1286abf-4141-4a6e-8fb7-f389702e88f8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:50.864144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b1286abf-4141-4a6e-8fb7-f389702e88f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:50.896581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:50.928635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 567/1148] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:50.950610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f4acd-8060-4e36-9479-9f43660d9481 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:51.052023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f4acd-8060-4e36-9479-9f43660d9481 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:51.085936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d849bd-a8cb-4379-9d06-c197abea58df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:51.086727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d849bd-a8cb-4379-9d06-c197abea58df None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:51.087010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d849bd-a8cb-4379-9d06-c197abea58df None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:51.087285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d849bd-a8cb-4379-9d06-c197abea58df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:51.097445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d849bd-a8cb-4379-9d06-c197abea58df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f9d849bd-a8cb-4379-9d06-c197abea58df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:51.105956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:51.107172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:51.108358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 582/1149] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:17:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:51.113232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1286abf-4141-4a6e-8fb7-f389702e88f8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:51.208273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1286abf-4141-4a6e-8fb7-f389702e88f8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:51.241021 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0095fa-61e2-4f18-b21c-c8871ad6eb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:51.241677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0095fa-61e2-4f18-b21c-c8871ad6eb09 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:51.241973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0095fa-61e2-4f18-b21c-c8871ad6eb09 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:51.242251 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0095fa-61e2-4f18-b21c-c8871ad6eb09 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:51.243018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0095fa-61e2-4f18-b21c-c8871ad6eb09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:51.243325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0095fa-61e2-4f18-b21c-c8871ad6eb09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:51.244705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0095fa-61e2-4f18-b21c-c8871ad6eb09 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:51.252455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 568/1150] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:17:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:51.258454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d849bd-a8cb-4379-9d06-c197abea58df None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:51.271537 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:51.355733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d849bd-a8cb-4379-9d06-c197abea58df None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:51.387275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750d40a-e357-4cee-a86b-0ced5b7a9c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:51.388123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750d40a-e357-4cee-a86b-0ced5b7a9c71 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:51.388399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750d40a-e357-4cee-a86b-0ced5b7a9c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:51.388697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4750d40a-e357-4cee-a86b-0ced5b7a9c71 None admin] PATH_INFO: `/v3/users/0cc8363a4b28494086de558b8a049578` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:51.389866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750d40a-e357-4cee-a86b-0ced5b7a9c71 None admin] RBAC: Authorizing `identity:get_user(user_id=0cc8363a4b28494086de558b8a049578)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:51.391279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4750d40a-e357-4cee-a86b-0ced5b7a9c71 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:51.392895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 583/1151] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:51 2022] GET /identity/v3/users/0cc8363a4b28494086de558b8a049578 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:51.399006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0095fa-61e2-4f18-b21c-c8871ad6eb09 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:51.430067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:51.497194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0095fa-61e2-4f18-b21c-c8871ad6eb09 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:51.530616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe37de-0dbe-4782-a1a7-f70378eae58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:51.531458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe37de-0dbe-4782-a1a7-f70378eae58c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:51.531740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe37de-0dbe-4782-a1a7-f70378eae58c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:51.532016 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe37de-0dbe-4782-a1a7-f70378eae58c None admin] PATH_INFO: `/v3/projects/0359d85dcd49406da4f2ecc2b8822fea` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:51.533196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe37de-0dbe-4782-a1a7-f70378eae58c None admin] RBAC: Authorizing `identity:get_project(project_id=0359d85dcd49406da4f2ecc2b8822fea)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:51.534616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe37de-0dbe-4782-a1a7-f70378eae58c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:51.536409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 569/1152] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:17:51 2022] GET /identity/v3/projects/0359d85dcd49406da4f2ecc2b8822fea => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:51.542261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750d40a-e357-4cee-a86b-0ced5b7a9c71 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:51.617659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:51.638396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4750d40a-e357-4cee-a86b-0ced5b7a9c71 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:51.670887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56087079-0a9d-4bf8-a1c4-fb808ce80ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:51.671756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087079-0a9d-4bf8-a1c4-fb808ce80ec7 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:51.672029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087079-0a9d-4bf8-a1c4-fb808ce80ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:51.672297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56087079-0a9d-4bf8-a1c4-fb808ce80ec7 None admin] PATH_INFO: `/v3/projects/0359d85dcd49406da4f2ecc2b8822fea/users/0cc8363a4b28494086de558b8a049578/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:51.674226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56087079-0a9d-4bf8-a1c4-fb808ce80ec7 None admin] RBAC: Authorizing `identity:create_grant(project_id=0359d85dcd49406da4f2ecc2b8822fea, user_id=0cc8363a4b28494086de558b8a049578, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:51.675652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56087079-0a9d-4bf8-a1c4-fb808ce80ec7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:51.780719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 584/1153] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:17:51 2022] PUT /identity/v3/projects/0359d85dcd49406da4f2ecc2b8822fea/users/0cc8363a4b28494086de558b8a049578/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:17:53.953146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd392299-96cc-4b9f-a326-24de3b7ee2ea None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:53.953686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd392299-96cc-4b9f-a326-24de3b7ee2ea None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:53.953780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd392299-96cc-4b9f-a326-24de3b7ee2ea None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:53.955086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 570/1154] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:53.961031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dc44d-a74c-4b16-8198-2b36d506a207 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:53.961469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dc44d-a74c-4b16-8198-2b36d506a207 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:53.961572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53dc44d-a74c-4b16-8198-2b36d506a207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:53.979982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c53dc44d-a74c-4b16-8198-2b36d506a207 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:53.981180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c53dc44d-a74c-4b16-8198-2b36d506a207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:54.045016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 585/1155] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:54.069856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd392299-96cc-4b9f-a326-24de3b7ee2ea None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:54.165594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:54.169155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd392299-96cc-4b9f-a326-24de3b7ee2ea None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:54.202898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a85ae-92ad-47f9-b1be-e97495a762cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:54.203728 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a85ae-92ad-47f9-b1be-e97495a762cb None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:54.203974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a85ae-92ad-47f9-b1be-e97495a762cb None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:54.204252 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a85ae-92ad-47f9-b1be-e97495a762cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:54.215062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a85ae-92ad-47f9-b1be-e97495a762cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-858a85ae-92ad-47f9-b1be-e97495a762cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:17:54.223516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:54.224732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:17:54.225807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 571/1156] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:17:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:54.230751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dc44d-a74c-4b16-8198-2b36d506a207 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:54.296337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:54.328632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53dc44d-a74c-4b16-8198-2b36d506a207 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:54.360906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115c8c4-7039-4a91-bef8-76d366cb43de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:54.361558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115c8c4-7039-4a91-bef8-76d366cb43de None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:54.361833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115c8c4-7039-4a91-bef8-76d366cb43de None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:54.362104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e115c8c4-7039-4a91-bef8-76d366cb43de None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:54.362835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115c8c4-7039-4a91-bef8-76d366cb43de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:54.363689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115c8c4-7039-4a91-bef8-76d366cb43de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:54.365136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e115c8c4-7039-4a91-bef8-76d366cb43de None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:54.372862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 586/1157] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:17:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:54.379299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a85ae-92ad-47f9-b1be-e97495a762cb None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:54.475432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a85ae-92ad-47f9-b1be-e97495a762cb None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:54.507544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70a18c-86b2-40bf-b871-c53410900814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:54.508390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70a18c-86b2-40bf-b871-c53410900814 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:54.508698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70a18c-86b2-40bf-b871-c53410900814 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:54.508963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70a18c-86b2-40bf-b871-c53410900814 None admin] PATH_INFO: `/v3/users/0cc8363a4b28494086de558b8a049578` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:54.510122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70a18c-86b2-40bf-b871-c53410900814 None admin] RBAC: Authorizing `identity:get_user(user_id=0cc8363a4b28494086de558b8a049578)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:54.511552 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70a18c-86b2-40bf-b871-c53410900814 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:54.513189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 572/1158] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:17:54 2022] GET /identity/v3/users/0cc8363a4b28494086de558b8a049578 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:54.518828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115c8c4-7039-4a91-bef8-76d366cb43de None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:54.620061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e115c8c4-7039-4a91-bef8-76d366cb43de None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:54.648118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:54.653694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e41ab-996b-4f87-9b3e-f63ae66eab9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:54.654335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e41ab-996b-4f87-9b3e-f63ae66eab9b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:54.654616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e41ab-996b-4f87-9b3e-f63ae66eab9b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:54.654892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e41ab-996b-4f87-9b3e-f63ae66eab9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:54.719669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e41ab-996b-4f87-9b3e-f63ae66eab9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:54.721155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e41ab-996b-4f87-9b3e-f63ae66eab9b None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:54.814535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 587/1159] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:17:54.820551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70a18c-86b2-40bf-b871-c53410900814 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:54.849793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:54.919003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70a18c-86b2-40bf-b871-c53410900814 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:54.951738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0708ad-f506-445d-9aae-d9441a6c123c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:54.952613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0708ad-f506-445d-9aae-d9441a6c123c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:54.952894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0708ad-f506-445d-9aae-d9441a6c123c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:54.953166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0708ad-f506-445d-9aae-d9441a6c123c None admin] PATH_INFO: `/v3/projects/0359d85dcd49406da4f2ecc2b8822fea` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:54.954338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0708ad-f506-445d-9aae-d9441a6c123c None admin] RBAC: Authorizing `identity:get_project(project_id=0359d85dcd49406da4f2ecc2b8822fea)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:54.955763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0708ad-f506-445d-9aae-d9441a6c123c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:54.958100 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 573/1160] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:17:54 2022] GET /identity/v3/projects/0359d85dcd49406da4f2ecc2b8822fea => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:54.964461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e41ab-996b-4f87-9b3e-f63ae66eab9b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:54.995319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:55.063238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e41ab-996b-4f87-9b3e-f63ae66eab9b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:55.096867 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3707a58-c323-464a-98ec-6b3b633a3f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:55.098237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707a58-c323-464a-98ec-6b3b633a3f63 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:55.098660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707a58-c323-464a-98ec-6b3b633a3f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:55.098943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3707a58-c323-464a-98ec-6b3b633a3f63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:55.099771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707a58-c323-464a-98ec-6b3b633a3f63 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=0359d85dcd49406da4f2ecc2b8822fea, user.id=0cc8363a4b28494086de558b8a049578) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:55.100087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707a58-c323-464a-98ec-6b3b633a3f63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:55.101572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3707a58-c323-464a-98ec-6b3b633a3f63 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:55.107270 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 588/1161] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:17:54 2022] GET /identity/v3/role_assignments?user.id=0cc8363a4b28494086de558b8a049578&scope.project.id=0359d85dcd49406da4f2ecc2b8822fea&role.id=7c09d078126441909df0a46212ffea63 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:17:57.308671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d3b75-9096-498a-8c59-8166079dfa59 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:57.309259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d3b75-9096-498a-8c59-8166079dfa59 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:57.309259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d3b75-9096-498a-8c59-8166079dfa59 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:57.310605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 574/1162] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:17:57.315959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6bde2-4b18-4fa1-97b3-24853c679047 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:57.317061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6bde2-4b18-4fa1-97b3-24853c679047 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:57.317200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6bde2-4b18-4fa1-97b3-24853c679047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:57.333403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-33e6bde2-4b18-4fa1-97b3-24853c679047 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:17:57.334575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-33e6bde2-4b18-4fa1-97b3-24853c679047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:17:57.398582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 589/1163] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:17:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:17:57.421241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d3b75-9096-498a-8c59-8166079dfa59 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:57.514522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:57.521141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d3b75-9096-498a-8c59-8166079dfa59 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:57.554282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0a1b7-124c-47e7-81d1-003fcf0189df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:57.554918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0a1b7-124c-47e7-81d1-003fcf0189df None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:57.555206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0a1b7-124c-47e7-81d1-003fcf0189df None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:57.555483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f0a1b7-124c-47e7-81d1-003fcf0189df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:57.621660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0a1b7-124c-47e7-81d1-003fcf0189df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:57.623115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f0a1b7-124c-47e7-81d1-003fcf0189df None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:57.711558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:57.718391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 575/1164] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:17:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:17:57.725088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6bde2-4b18-4fa1-97b3-24853c679047 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:57.749119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:17:57.820470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6bde2-4b18-4fa1-97b3-24853c679047 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:57.853034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbfc017-2712-40bf-ac11-46f8258b854d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:57.853757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc017-2712-40bf-ac11-46f8258b854d None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:57.854031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc017-2712-40bf-ac11-46f8258b854d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:57.854304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbfc017-2712-40bf-ac11-46f8258b854d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:57.860621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfc017-2712-40bf-ac11-46f8258b854d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:57.862065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbfc017-2712-40bf-ac11-46f8258b854d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ebbfc017-2712-40bf-ac11-46f8258b854d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:17:57.875555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:17:57.876896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:17:57.878099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 590/1165] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:17:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:17:57.882618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0a1b7-124c-47e7-81d1-003fcf0189df None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:17:57.982702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f0a1b7-124c-47e7-81d1-003fcf0189df None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:17:58.014462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebbb08-e3bb-4e15-866e-6d026a63f2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:17:58.015106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebbb08-e3bb-4e15-866e-6d026a63f2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:17:58.015393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebbb08-e3bb-4e15-866e-6d026a63f2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:17:58.015667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebbb08-e3bb-4e15-866e-6d026a63f2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:17:58.016377 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebbb08-e3bb-4e15-866e-6d026a63f2b9 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:17:58.016713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebbb08-e3bb-4e15-866e-6d026a63f2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:17:58.018057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebbb08-e3bb-4e15-866e-6d026a63f2b9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:17:58.025598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 576/1166] 10.222.0.24 () {56 vars in 1115 bytes} [Wed May 25 07:17:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:00.190398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0cdc-58e0-461b-b150-7e49a4f39386 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:00.190996 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0cdc-58e0-461b-b150-7e49a4f39386 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:00.191096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec0cdc-58e0-461b-b150-7e49a4f39386 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:00.192383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 591/1167] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:18:00.197718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cd7bc-f951-46d1-b716-417cd734a1ae None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:00.198157 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cd7bc-f951-46d1-b716-417cd734a1ae None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:00.198269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698cd7bc-f951-46d1-b716-417cd734a1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:00.215436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-698cd7bc-f951-46d1-b716-417cd734a1ae None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:18:00.216921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-698cd7bc-f951-46d1-b716-417cd734a1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:18:00.271213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:00.281868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 577/1168] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:18:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:18:00.304878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec0cdc-58e0-461b-b150-7e49a4f39386 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:00.387497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:00.403911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec0cdc-58e0-461b-b150-7e49a4f39386 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:00.437364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e037506-9ec1-456a-ba2d-14062fe30d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:00.438010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e037506-9ec1-456a-ba2d-14062fe30d5a None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:00.438287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e037506-9ec1-456a-ba2d-14062fe30d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:00.438557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e037506-9ec1-456a-ba2d-14062fe30d5a None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:00.439278 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e037506-9ec1-456a-ba2d-14062fe30d5a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:00.440723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e037506-9ec1-456a-ba2d-14062fe30d5a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:00.509312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 592/1169] 10.222.0.24 () {60 vars in 1138 bytes} [Wed May 25 07:18:00 2022] POST /identity/v3/domains => generated 267 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:18:02.766510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29270-31ca-461f-b592-bb3b012bd149 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:02.767050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29270-31ca-461f-b592-bb3b012bd149 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:02.767050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc29270-31ca-461f-b592-bb3b012bd149 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:02.768421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 578/1170] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:18:02.774302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd5da-916e-408a-9386-734a4cd9d172 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:02.774741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd5da-916e-408a-9386-734a4cd9d172 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:02.774841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bd5da-916e-408a-9386-734a4cd9d172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:02.791182 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-173bd5da-916e-408a-9386-734a4cd9d172 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:18:02.792363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-173bd5da-916e-408a-9386-734a4cd9d172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:18:02.856177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 593/1171] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:18:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:18:02.879699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc29270-31ca-461f-b592-bb3b012bd149 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:02.976574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc29270-31ca-461f-b592-bb3b012bd149 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:03.009903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee42c88-fa36-4375-acec-d001435d7bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:03.010740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee42c88-fa36-4375-acec-d001435d7bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:03.011018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee42c88-fa36-4375-acec-d001435d7bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:03.011288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee42c88-fa36-4375-acec-d001435d7bb6 None admin] PATH_INFO: `/v3/domains/48c9ef8eb3784678b2cf1764e80527f0` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:03.022108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee42c88-fa36-4375-acec-d001435d7bb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=48c9ef8eb3784678b2cf1764e80527f0)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:03.023534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee42c88-fa36-4375-acec-d001435d7bb6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:03.025241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 579/1172] 10.222.0.24 () {56 vars in 1183 bytes} [Wed May 25 07:18:02 2022] GET /identity/v3/domains/48c9ef8eb3784678b2cf1764e80527f0 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:03.031022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd5da-916e-408a-9386-734a4cd9d172 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:03.101738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:03.125172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bd5da-916e-408a-9386-734a4cd9d172 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:03.157935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59098ffa-301e-4240-bd21-a71f8ff51fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:03.158583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59098ffa-301e-4240-bd21-a71f8ff51fb1 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:03.158863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59098ffa-301e-4240-bd21-a71f8ff51fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:03.159137 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59098ffa-301e-4240-bd21-a71f8ff51fb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:03.159955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59098ffa-301e-4240-bd21-a71f8ff51fb1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:03.161418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59098ffa-301e-4240-bd21-a71f8ff51fb1 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:03.280320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 594/1173] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:18:03 2022] POST /identity/v3/projects => generated 361 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:18:05.530814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f01a58-adc5-478b-93ba-8b37c783c7e0 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:05.531372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f01a58-adc5-478b-93ba-8b37c783c7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:05.531474 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f01a58-adc5-478b-93ba-8b37c783c7e0 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:05.532850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 580/1174] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:18:05.538789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea537-23ab-4786-8a4d-1c4358b89b1f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:05.539220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea537-23ab-4786-8a4d-1c4358b89b1f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:05.539353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea537-23ab-4786-8a4d-1c4358b89b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:05.557077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-956ea537-23ab-4786-8a4d-1c4358b89b1f None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:18:05.558260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-956ea537-23ab-4786-8a4d-1c4358b89b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:18:05.624024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 595/1175] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:18:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:18:05.648565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f01a58-adc5-478b-93ba-8b37c783c7e0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:05.698432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:05.748163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f01a58-adc5-478b-93ba-8b37c783c7e0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:05.780911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1235b68f-434e-4b74-8232-51d3245a8906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:05.781700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b68f-434e-4b74-8232-51d3245a8906 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:05.781980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b68f-434e-4b74-8232-51d3245a8906 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:05.782259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1235b68f-434e-4b74-8232-51d3245a8906 None admin] PATH_INFO: `/v3/domains/48c9ef8eb3784678b2cf1764e80527f0` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:05.783419 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235b68f-434e-4b74-8232-51d3245a8906 None admin] RBAC: Authorizing `identity:get_domain(domain_id=48c9ef8eb3784678b2cf1764e80527f0)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:05.785449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1235b68f-434e-4b74-8232-51d3245a8906 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:05.787064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 581/1176] 10.222.0.24 () {56 vars in 1183 bytes} [Wed May 25 07:18:05 2022] GET /identity/v3/domains/48c9ef8eb3784678b2cf1764e80527f0 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:05.792691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea537-23ab-4786-8a4d-1c4358b89b1f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:05.846318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:05.887184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea537-23ab-4786-8a4d-1c4358b89b1f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:05.919444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4dbc31-0eb6-47e5-9f3a-bb8f9f5a8d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:05.920098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dbc31-0eb6-47e5-9f3a-bb8f9f5a8d8d None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:05.920378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dbc31-0eb6-47e5-9f3a-bb8f9f5a8d8d None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:05.920685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4dbc31-0eb6-47e5-9f3a-bb8f9f5a8d8d None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:05.921392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dbc31-0eb6-47e5-9f3a-bb8f9f5a8d8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:05.922831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4dbc31-0eb6-47e5-9f3a-bb8f9f5a8d8d None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:06.013163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 596/1177] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:18:05 2022] POST /identity/v3/users => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:18:08.254614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c5db5-212c-4fcb-b371-6f812ba93ed0 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:08.255138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c5db5-212c-4fcb-b371-6f812ba93ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:08.255262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c5db5-212c-4fcb-b371-6f812ba93ed0 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:08.256559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 582/1178] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:18:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:18:08.261763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa366934-e230-48bd-b544-11f862331d28 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:08.262196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa366934-e230-48bd-b544-11f862331d28 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:08.262312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa366934-e230-48bd-b544-11f862331d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:08.279275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-aa366934-e230-48bd-b544-11f862331d28 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:18:08.280447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-aa366934-e230-48bd-b544-11f862331d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:18:08.344219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 597/1179] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:18:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:18:08.367535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c5db5-212c-4fcb-b371-6f812ba93ed0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:08.466653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c5db5-212c-4fcb-b371-6f812ba93ed0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:08.483238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:08.499477 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7ac59-66fb-4506-ae0c-cde2fe9b48ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:08.500255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7ac59-66fb-4506-ae0c-cde2fe9b48ae None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:08.500571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7ac59-66fb-4506-ae0c-cde2fe9b48ae None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:08.500849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7ac59-66fb-4506-ae0c-cde2fe9b48ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:08.511358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7ac59-66fb-4506-ae0c-cde2fe9b48ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7ae7ac59-66fb-4506-ae0c-cde2fe9b48ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:18:08.519415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:18:08.520595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:18:08.521533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 583/1180] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:18:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:18:08.526659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa366934-e230-48bd-b544-11f862331d28 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:08.568317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:08.622423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa366934-e230-48bd-b544-11f862331d28 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:08.655475 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d99575-5700-4c82-b7f7-546799de5d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:08.656140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99575-5700-4c82-b7f7-546799de5d19 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:08.656424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99575-5700-4c82-b7f7-546799de5d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:08.656737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d99575-5700-4c82-b7f7-546799de5d19 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:08.657484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d99575-5700-4c82-b7f7-546799de5d19 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:18:08.657794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d99575-5700-4c82-b7f7-546799de5d19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:08.659172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d99575-5700-4c82-b7f7-546799de5d19 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:08.667629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 598/1181] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:18:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:08.673344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7ac59-66fb-4506-ae0c-cde2fe9b48ae None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:08.771946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7ac59-66fb-4506-ae0c-cde2fe9b48ae None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:08.805524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d80af-a2f3-4590-b4fa-b4705a6d59bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:08.806391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d80af-a2f3-4590-b4fa-b4705a6d59bd None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:08.806675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d80af-a2f3-4590-b4fa-b4705a6d59bd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:08.806955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d80af-a2f3-4590-b4fa-b4705a6d59bd None admin] PATH_INFO: `/v3/users/267e11b98e8d4ca19ef135b540e074da` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:08.819791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d80af-a2f3-4590-b4fa-b4705a6d59bd None admin] RBAC: Authorizing `identity:get_user(user_id=267e11b98e8d4ca19ef135b540e074da)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:08.821265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909d80af-a2f3-4590-b4fa-b4705a6d59bd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:08.822913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 584/1182] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:18:08 2022] GET /identity/v3/users/267e11b98e8d4ca19ef135b540e074da => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:08.828720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d99575-5700-4c82-b7f7-546799de5d19 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:08.924599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d99575-5700-4c82-b7f7-546799de5d19 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:08.926940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:08.957098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633dd84-ea71-4f24-9f84-1f6496241fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:08.957735 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633dd84-ea71-4f24-9f84-1f6496241fed None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:08.958020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633dd84-ea71-4f24-9f84-1f6496241fed None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:08.958296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8633dd84-ea71-4f24-9f84-1f6496241fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:09.025332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633dd84-ea71-4f24-9f84-1f6496241fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:09.026716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8633dd84-ea71-4f24-9f84-1f6496241fed None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:09.121227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 599/1183] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:18:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 07:18:09.127074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d80af-a2f3-4590-b4fa-b4705a6d59bd None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:09.161191 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:09.223843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d80af-a2f3-4590-b4fa-b4705a6d59bd None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:09.257496 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3312ae-f54f-4a41-bda6-e791dd77bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:09.258342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3312ae-f54f-4a41-bda6-e791dd77bb75 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:09.258622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3312ae-f54f-4a41-bda6-e791dd77bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:09.258895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3312ae-f54f-4a41-bda6-e791dd77bb75 None admin] PATH_INFO: `/v3/projects/e9b1e7e014c1457a999b39ef25c0361b` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:09.260064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3312ae-f54f-4a41-bda6-e791dd77bb75 None admin] RBAC: Authorizing `identity:get_project(project_id=e9b1e7e014c1457a999b39ef25c0361b)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:09.261515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3312ae-f54f-4a41-bda6-e791dd77bb75 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:09.263200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 585/1184] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:18:09 2022] GET /identity/v3/projects/e9b1e7e014c1457a999b39ef25c0361b => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:09.269527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633dd84-ea71-4f24-9f84-1f6496241fed None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:09.272616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:09.372049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8633dd84-ea71-4f24-9f84-1f6496241fed None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:09.404966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fb2a2-5672-4da8-aec3-a2883e3302d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:09.405600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb2a2-5672-4da8-aec3-a2883e3302d0 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:09.405875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb2a2-5672-4da8-aec3-a2883e3302d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:09.406144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fb2a2-5672-4da8-aec3-a2883e3302d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:09.406958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fb2a2-5672-4da8-aec3-a2883e3302d0 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=e9b1e7e014c1457a999b39ef25c0361b, user.id=267e11b98e8d4ca19ef135b540e074da) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:18:09.407262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fb2a2-5672-4da8-aec3-a2883e3302d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:09.408717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fb2a2-5672-4da8-aec3-a2883e3302d0 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:09.414444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 600/1185] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:18:09 2022] GET /identity/v3/role_assignments?user.id=267e11b98e8d4ca19ef135b540e074da&scope.project.id=e9b1e7e014c1457a999b39ef25c0361b&role.id=7c09d078126441909df0a46212ffea63 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:11.594273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1841e6-a622-4839-ad05-1298b1c2fe7a None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:11.594653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1841e6-a622-4839-ad05-1298b1c2fe7a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:11.594827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1841e6-a622-4839-ad05-1298b1c2fe7a None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:11.596196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 586/1186] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:18:11.601706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76b2b1-3d39-4cb2-8c77-fabae6e7ace0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:11.602115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76b2b1-3d39-4cb2-8c77-fabae6e7ace0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:11.602258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76b2b1-3d39-4cb2-8c77-fabae6e7ace0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:11.619894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2e76b2b1-3d39-4cb2-8c77-fabae6e7ace0 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:18:11.621107 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2e76b2b1-3d39-4cb2-8c77-fabae6e7ace0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:18:11.680042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:11.685239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 601/1187] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:18:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:18:11.707434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1841e6-a622-4839-ad05-1298b1c2fe7a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:11.805790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1841e6-a622-4839-ad05-1298b1c2fe7a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:11.808027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:11.838044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8d0c-161d-4724-84a4-ea924724d42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:11.838826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8d0c-161d-4724-84a4-ea924724d42a None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:11.839104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8d0c-161d-4724-84a4-ea924724d42a None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:11.839374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb8d0c-161d-4724-84a4-ea924724d42a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:11.850477 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb8d0c-161d-4724-84a4-ea924724d42a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e8cb8d0c-161d-4724-84a4-ea924724d42a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:18:11.858054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:18:11.859160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:18:11.860225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 587/1188] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:18:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:18:11.865907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76b2b1-3d39-4cb2-8c77-fabae6e7ace0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:11.959097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76b2b1-3d39-4cb2-8c77-fabae6e7ace0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:11.992397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb18f4-6c52-4417-beb8-330b0e8ca55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:11.993076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb18f4-6c52-4417-beb8-330b0e8ca55a None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:11.993354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb18f4-6c52-4417-beb8-330b0e8ca55a None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:11.993628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb18f4-6c52-4417-beb8-330b0e8ca55a None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:11.994360 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb18f4-6c52-4417-beb8-330b0e8ca55a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:18:11.994665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb18f4-6c52-4417-beb8-330b0e8ca55a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:11.996037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb18f4-6c52-4417-beb8-330b0e8ca55a None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:12.003767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 602/1189] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:18:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:12.009557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8d0c-161d-4724-84a4-ea924724d42a None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:12.108839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb8d0c-161d-4724-84a4-ea924724d42a None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:12.140305 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8a07b-b84e-48c9-beda-27a0919ad6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:12.141178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8a07b-b84e-48c9-beda-27a0919ad6db None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:12.141451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8a07b-b84e-48c9-beda-27a0919ad6db None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:12.141716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d8a07b-b84e-48c9-beda-27a0919ad6db None admin] PATH_INFO: `/v3/users/267e11b98e8d4ca19ef135b540e074da` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:12.142875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8a07b-b84e-48c9-beda-27a0919ad6db None admin] RBAC: Authorizing `identity:get_user(user_id=267e11b98e8d4ca19ef135b540e074da)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:12.145103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d8a07b-b84e-48c9-beda-27a0919ad6db None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:12.146695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 588/1190] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:18:12 2022] GET /identity/v3/users/267e11b98e8d4ca19ef135b540e074da => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:12.152344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb18f4-6c52-4417-beb8-330b0e8ca55a None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:12.209107 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:12.248092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb18f4-6c52-4417-beb8-330b0e8ca55a None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:12.280460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3dbdc0-226e-4819-b46b-3eb292128ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:12.281348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dbdc0-226e-4819-b46b-3eb292128ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:12.281628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dbdc0-226e-4819-b46b-3eb292128ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:12.281900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3dbdc0-226e-4819-b46b-3eb292128ab7 None admin] PATH_INFO: `/v3/projects/e9b1e7e014c1457a999b39ef25c0361b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:12.283056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dbdc0-226e-4819-b46b-3eb292128ab7 None admin] RBAC: Authorizing `identity:get_project(project_id=e9b1e7e014c1457a999b39ef25c0361b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:12.285171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3dbdc0-226e-4819-b46b-3eb292128ab7 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:12.286996 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 603/1191] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:18:12 2022] GET /identity/v3/projects/e9b1e7e014c1457a999b39ef25c0361b => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:18:12.292863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8a07b-b84e-48c9-beda-27a0919ad6db None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:12.323040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:12.388674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d8a07b-b84e-48c9-beda-27a0919ad6db None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:12.422114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f877cd-fa0a-400d-a410-9d1f1cc89d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:12.422987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f877cd-fa0a-400d-a410-9d1f1cc89d61 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:12.423268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f877cd-fa0a-400d-a410-9d1f1cc89d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:12.423544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f877cd-fa0a-400d-a410-9d1f1cc89d61 None admin] PATH_INFO: `/v3/projects/e9b1e7e014c1457a999b39ef25c0361b/users/267e11b98e8d4ca19ef135b540e074da/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:12.425541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f877cd-fa0a-400d-a410-9d1f1cc89d61 None admin] RBAC: Authorizing `identity:create_grant(project_id=e9b1e7e014c1457a999b39ef25c0361b, user_id=267e11b98e8d4ca19ef135b540e074da, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:12.426961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f877cd-fa0a-400d-a410-9d1f1cc89d61 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:12.501856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 589/1192] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:18:12 2022] PUT /identity/v3/projects/e9b1e7e014c1457a999b39ef25c0361b/users/267e11b98e8d4ca19ef135b540e074da/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:18:14.687919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1de0e-65ea-4362-8f06-62c7247683d4 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:14.688506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1de0e-65ea-4362-8f06-62c7247683d4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:14.688506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d1de0e-65ea-4362-8f06-62c7247683d4 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:14.689862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 604/1193] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:18:14.695706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a2a1d-2191-4d42-8d6c-411c1df31764 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:14.696147 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a2a1d-2191-4d42-8d6c-411c1df31764 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:14.696267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5a2a1d-2191-4d42-8d6c-411c1df31764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:14.713262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4f5a2a1d-2191-4d42-8d6c-411c1df31764 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:18:14.714446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4f5a2a1d-2191-4d42-8d6c-411c1df31764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:18:14.779473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 590/1194] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:18:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:18:14.802596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1de0e-65ea-4362-8f06-62c7247683d4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:14.900287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d1de0e-65ea-4362-8f06-62c7247683d4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:14.924239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:14.932001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166a32d-f5e2-46d0-865a-59224abecdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:14.937482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166a32d-f5e2-46d0-865a-59224abecdac None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:14.937482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166a32d-f5e2-46d0-865a-59224abecdac None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:14.937482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166a32d-f5e2-46d0-865a-59224abecdac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:14.943937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166a32d-f5e2-46d0-865a-59224abecdac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-f166a32d-f5e2-46d0-865a-59224abecdac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:18:14.951491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:18:14.952642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:18:14.953736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 605/1195] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:18:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:18:14.961257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a2a1d-2191-4d42-8d6c-411c1df31764 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:14.984615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:15.057616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5a2a1d-2191-4d42-8d6c-411c1df31764 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:15.090874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06459-8959-43e4-aff1-22fef1763229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:15.091781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06459-8959-43e4-aff1-22fef1763229 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:15.092061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06459-8959-43e4-aff1-22fef1763229 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:15.092332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06459-8959-43e4-aff1-22fef1763229 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:15.093101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06459-8959-43e4-aff1-22fef1763229 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:18:15.093405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06459-8959-43e4-aff1-22fef1763229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:15.094766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06459-8959-43e4-aff1-22fef1763229 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:15.102684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 591/1196] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:18:15.108417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166a32d-f5e2-46d0-865a-59224abecdac None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:15.203857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166a32d-f5e2-46d0-865a-59224abecdac None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:15.235948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c2efa-b9da-4192-83d5-d0eb6053d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:15.236845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c2efa-b9da-4192-83d5-d0eb6053d339 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:15.237122 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c2efa-b9da-4192-83d5-d0eb6053d339 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:15.237921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c2efa-b9da-4192-83d5-d0eb6053d339 None admin] PATH_INFO: `/v3/users/267e11b98e8d4ca19ef135b540e074da` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:15.239158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c2efa-b9da-4192-83d5-d0eb6053d339 None admin] RBAC: Authorizing `identity:get_user(user_id=267e11b98e8d4ca19ef135b540e074da)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:15.240655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c2efa-b9da-4192-83d5-d0eb6053d339 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:15.242245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 606/1197] 10.222.0.24 () {56 vars in 1177 bytes} [Wed May 25 07:18:15 2022] GET /identity/v3/users/267e11b98e8d4ca19ef135b540e074da => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:15.247933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06459-8959-43e4-aff1-22fef1763229 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:15.329478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:15.344699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06459-8959-43e4-aff1-22fef1763229 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:15.377025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb0943-5d7d-45dc-8af3-c45b813bdd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:15.377659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0943-5d7d-45dc-8af3-c45b813bdd0d None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:15.378495 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0943-5d7d-45dc-8af3-c45b813bdd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:15.378765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb0943-5d7d-45dc-8af3-c45b813bdd0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:15.442945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb0943-5d7d-45dc-8af3-c45b813bdd0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:15.444380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb0943-5d7d-45dc-8af3-c45b813bdd0d None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:15.523211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:15.539297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 592/1198] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:18:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:18:15.545202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c2efa-b9da-4192-83d5-d0eb6053d339 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:15.601969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:15.644767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c2efa-b9da-4192-83d5-d0eb6053d339 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:15.678136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119ab55-b620-4df1-88cc-7176c39e7c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:15.678973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119ab55-b620-4df1-88cc-7176c39e7c79 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:15.679248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119ab55-b620-4df1-88cc-7176c39e7c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:15.679518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119ab55-b620-4df1-88cc-7176c39e7c79 None admin] PATH_INFO: `/v3/projects/e9b1e7e014c1457a999b39ef25c0361b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:15.680698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119ab55-b620-4df1-88cc-7176c39e7c79 None admin] RBAC: Authorizing `identity:get_project(project_id=e9b1e7e014c1457a999b39ef25c0361b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:15.682131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119ab55-b620-4df1-88cc-7176c39e7c79 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:15.683790 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 607/1199] 10.222.0.24 () {56 vars in 1186 bytes} [Wed May 25 07:18:15 2022] GET /identity/v3/projects/e9b1e7e014c1457a999b39ef25c0361b => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:15.689790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb0943-5d7d-45dc-8af3-c45b813bdd0d None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:18:15.785847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb0943-5d7d-45dc-8af3-c45b813bdd0d None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:18:15.818257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7975aaa2-3bed-44a1-a4bd-19cf36974249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:18:15.818890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975aaa2-3bed-44a1-a4bd-19cf36974249 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:18:15.819167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975aaa2-3bed-44a1-a4bd-19cf36974249 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:18:15.819439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7975aaa2-3bed-44a1-a4bd-19cf36974249 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:18:15.820258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975aaa2-3bed-44a1-a4bd-19cf36974249 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=e9b1e7e014c1457a999b39ef25c0361b, user.id=267e11b98e8d4ca19ef135b540e074da) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:18:15.820596 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975aaa2-3bed-44a1-a4bd-19cf36974249 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:18:15.822015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7975aaa2-3bed-44a1-a4bd-19cf36974249 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:18:15.827613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 593/1200] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:18:15 2022] GET /identity/v3/role_assignments?user.id=267e11b98e8d4ca19ef135b540e074da&scope.project.id=e9b1e7e014c1457a999b39ef25c0361b&role.id=7c09d078126441909df0a46212ffea63 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:18:25.673319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=38 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:18:25.825048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=76 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:38.107875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4714187-3581-4d03-a845-cd286dc2b525 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:38.108465 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4714187-3581-4d03-a845-cd286dc2b525 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:38.108465 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4714187-3581-4d03-a845-cd286dc2b525 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:38.109855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 608/1201] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:19:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:19:38.115002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3c66e-4b61-4690-af71-9eaebeb74722 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:38.115446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3c66e-4b61-4690-af71-9eaebeb74722 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:38.115544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e3c66e-4b61-4690-af71-9eaebeb74722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:38.132114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e9e3c66e-4b61-4690-af71-9eaebeb74722 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:19:38.133338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e9e3c66e-4b61-4690-af71-9eaebeb74722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:19:38.198138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 594/1202] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:19:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:19:38.223426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4714187-3581-4d03-a845-cd286dc2b525 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:38.327582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4714187-3581-4d03-a845-cd286dc2b525 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:38.360591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccee796-7ce2-4235-b38b-57f294c3194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:38.361312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccee796-7ce2-4235-b38b-57f294c3194e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:38.361589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccee796-7ce2-4235-b38b-57f294c3194e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:38.361859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccee796-7ce2-4235-b38b-57f294c3194e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:38.372174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccee796-7ce2-4235-b38b-57f294c3194e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:38.373663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccee796-7ce2-4235-b38b-57f294c3194e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-fccee796-7ce2-4235-b38b-57f294c3194e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:38.391921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:38.393080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:38.394103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:38.394103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:38.394103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:38.394103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:38.394103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 609/1203] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:38.399075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3c66e-4b61-4690-af71-9eaebeb74722 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:38.497622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e3c66e-4b61-4690-af71-9eaebeb74722 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:38.525029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:38.530702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45dfc2-c029-47f8-8f49-7790e4d6078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:38.531354 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45dfc2-c029-47f8-8f49-7790e4d6078c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:38.531634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45dfc2-c029-47f8-8f49-7790e4d6078c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:38.531903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45dfc2-c029-47f8-8f49-7790e4d6078c None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:38.532650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45dfc2-c029-47f8-8f49-7790e4d6078c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:38.532954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45dfc2-c029-47f8-8f49-7790e4d6078c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:38.534361 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df45dfc2-c029-47f8-8f49-7790e4d6078c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:38.545847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 595/1204] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:38.551601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccee796-7ce2-4235-b38b-57f294c3194e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:38.603142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:38.647169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccee796-7ce2-4235-b38b-57f294c3194e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:38.678787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c89fe-b76a-436d-aa19-58c569e88846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:38.679445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c89fe-b76a-436d-aa19-58c569e88846 None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:38.679722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c89fe-b76a-436d-aa19-58c569e88846 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:38.679997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c89fe-b76a-436d-aa19-58c569e88846 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:38.680712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c89fe-b76a-436d-aa19-58c569e88846 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:38.682139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27c89fe-b76a-436d-aa19-58c569e88846 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:38.815066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 610/1205] 10.222.0.24 () {60 vars in 1132 bytes} [Wed May 25 07:19:38 2022] POST /identity/v3/users => generated 251 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:19:41.052320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b894-44a4-42cd-83c0-b7a658a657a5 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:41.052966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b894-44a4-42cd-83c0-b7a658a657a5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:41.052966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7b894-44a4-42cd-83c0-b7a658a657a5 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:41.054284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 596/1206] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:19:41.059893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b9d33-bb97-4060-b7c9-07edf391f574 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:41.062031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b9d33-bb97-4060-b7c9-07edf391f574 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:41.062031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b9d33-bb97-4060-b7c9-07edf391f574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:41.077233 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e79b9d33-bb97-4060-b7c9-07edf391f574 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:19:41.078458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e79b9d33-bb97-4060-b7c9-07edf391f574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:19:41.144379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 611/1207] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:19:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:19:41.168861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7b894-44a4-42cd-83c0-b7a658a657a5 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:41.267954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7b894-44a4-42cd-83c0-b7a658a657a5 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:41.301259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f271b-0c32-4857-a4fd-e0f9d52314a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:41.302041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f271b-0c32-4857-a4fd-e0f9d52314a5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:41.302364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f271b-0c32-4857-a4fd-e0f9d52314a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:41.302594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f271b-0c32-4857-a4fd-e0f9d52314a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:41.312854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f271b-0c32-4857-a4fd-e0f9d52314a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f76f271b-0c32-4857-a4fd-e0f9d52314a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:19:41.320800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:41.321960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:41.322860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 597/1208] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:41.327905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b9d33-bb97-4060-b7c9-07edf391f574 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:41.367214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:41.425409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b9d33-bb97-4060-b7c9-07edf391f574 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:41.458304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b161c-7197-409e-99c6-8b783bd77180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:41.458958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b161c-7197-409e-99c6-8b783bd77180 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:41.459237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b161c-7197-409e-99c6-8b783bd77180 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:41.459508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803b161c-7197-409e-99c6-8b783bd77180 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:41.460275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b161c-7197-409e-99c6-8b783bd77180 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:41.460640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b161c-7197-409e-99c6-8b783bd77180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:41.462000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803b161c-7197-409e-99c6-8b783bd77180 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:41.470609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 612/1209] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:19:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:41.476253 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f271b-0c32-4857-a4fd-e0f9d52314a5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:41.525910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:41.576432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f271b-0c32-4857-a4fd-e0f9d52314a5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:41.611681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd456640-b70a-4ba3-80ba-76b3efbb3f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:41.612497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd456640-b70a-4ba3-80ba-76b3efbb3f8c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:41.612799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd456640-b70a-4ba3-80ba-76b3efbb3f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:41.613076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd456640-b70a-4ba3-80ba-76b3efbb3f8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:41.623850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd456640-b70a-4ba3-80ba-76b3efbb3f8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:41.625366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd456640-b70a-4ba3-80ba-76b3efbb3f8c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-fd456640-b70a-4ba3-80ba-76b3efbb3f8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:41.642992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:41.644064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:41.645400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:41.645400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:41.645400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:41.645400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:41.645400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 598/1210] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:41.649955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b161c-7197-409e-99c6-8b783bd77180 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:41.749441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:41.752159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803b161c-7197-409e-99c6-8b783bd77180 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:41.783920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8d39f-fef1-42ea-b381-c11f219173ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:41.784646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8d39f-fef1-42ea-b381-c11f219173ed None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:41.784924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8d39f-fef1-42ea-b381-c11f219173ed None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:41.785193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8d39f-fef1-42ea-b381-c11f219173ed None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:41.785903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8d39f-fef1-42ea-b381-c11f219173ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:41.786210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8d39f-fef1-42ea-b381-c11f219173ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:41.787655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8d39f-fef1-42ea-b381-c11f219173ed None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:41.799086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 613/1211] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:19:41.804883 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd456640-b70a-4ba3-80ba-76b3efbb3f8c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:41.905859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd456640-b70a-4ba3-80ba-76b3efbb3f8c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:41.907271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:41.939839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c130-5bfd-47a5-8773-7a582e5155ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:41.940662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c130-5bfd-47a5-8773-7a582e5155ae None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:41.940946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c130-5bfd-47a5-8773-7a582e5155ae None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:41.941218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47c130-5bfd-47a5-8773-7a582e5155ae None admin] PATH_INFO: `/v3/users/placement` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:41.948045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47c130-5bfd-47a5-8773-7a582e5155ae None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:41.950099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47c130-5bfd-47a5-8773-7a582e5155ae None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-bb47c130-5bfd-47a5-8773-7a582e5155ae None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:19:41.964276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:41.965769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:41.967262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 599/1212] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:41.971696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8d39f-fef1-42ea-b381-c11f219173ed None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:42.071111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8d39f-fef1-42ea-b381-c11f219173ed None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:42.105822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3599e-6bc7-433a-aa10-e6db034073e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:42.106691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3599e-6bc7-433a-aa10-e6db034073e5 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:42.106976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3599e-6bc7-433a-aa10-e6db034073e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:42.107257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf3599e-6bc7-433a-aa10-e6db034073e5 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:42.108120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3599e-6bc7-433a-aa10-e6db034073e5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:42.108509 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3599e-6bc7-433a-aa10-e6db034073e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:42.109945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf3599e-6bc7-433a-aa10-e6db034073e5 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:42.127456 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 614/1213] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 07:19:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:42.133463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c130-5bfd-47a5-8773-7a582e5155ae None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:42.232238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47c130-5bfd-47a5-8773-7a582e5155ae None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:42.266118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d39813-19cd-4df0-b6c5-f1baa3dd324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:42.266808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d39813-19cd-4df0-b6c5-f1baa3dd324b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:42.267089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d39813-19cd-4df0-b6c5-f1baa3dd324b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:42.267364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d39813-19cd-4df0-b6c5-f1baa3dd324b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:42.296543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:42.333713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d39813-19cd-4df0-b6c5-f1baa3dd324b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:42.335150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d39813-19cd-4df0-b6c5-f1baa3dd324b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:42.429973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 600/1214] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:19:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:19:42.436538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3599e-6bc7-433a-aa10-e6db034073e5 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:42.454857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:42.532863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf3599e-6bc7-433a-aa10-e6db034073e5 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:42.566422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26391f27-d882-4b3c-8269-0d9c4bb1cd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:42.567205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26391f27-d882-4b3c-8269-0d9c4bb1cd8e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:42.567481 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26391f27-d882-4b3c-8269-0d9c4bb1cd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:42.567749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26391f27-d882-4b3c-8269-0d9c4bb1cd8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:42.577477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26391f27-d882-4b3c-8269-0d9c4bb1cd8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:42.578913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26391f27-d882-4b3c-8269-0d9c4bb1cd8e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-26391f27-d882-4b3c-8269-0d9c4bb1cd8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:42.597865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:42.598969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:42.599912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:42.599912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:42.599912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:42.599912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:42.601394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 615/1215] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:42.604804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d39813-19cd-4df0-b6c5-f1baa3dd324b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:42.665356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:42.704088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d39813-19cd-4df0-b6c5-f1baa3dd324b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:42.737821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c63a6-3266-4ed5-bb6a-d6e979bfc3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:42.738559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c63a6-3266-4ed5-bb6a-d6e979bfc3ce None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:42.738838 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c63a6-3266-4ed5-bb6a-d6e979bfc3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:42.739109 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c63a6-3266-4ed5-bb6a-d6e979bfc3ce None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:42.739814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c63a6-3266-4ed5-bb6a-d6e979bfc3ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:42.740120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c63a6-3266-4ed5-bb6a-d6e979bfc3ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:42.741566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c63a6-3266-4ed5-bb6a-d6e979bfc3ce None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:42.753023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 601/1216] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:42.759445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26391f27-d882-4b3c-8269-0d9c4bb1cd8e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:42.826759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:42.857457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26391f27-d882-4b3c-8269-0d9c4bb1cd8e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:42.892349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6521f-a6d1-40a8-8bb1-60f29e97ab70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:42.893165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6521f-a6d1-40a8-8bb1-60f29e97ab70 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:42.893445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6521f-a6d1-40a8-8bb1-60f29e97ab70 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:42.893716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b6521f-a6d1-40a8-8bb1-60f29e97ab70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:42.900157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6521f-a6d1-40a8-8bb1-60f29e97ab70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:42.901776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b6521f-a6d1-40a8-8bb1-60f29e97ab70 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-82b6521f-a6d1-40a8-8bb1-60f29e97ab70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:19:42.916027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:42.917186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:42.918805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:19:42.918805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:19:42.918805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:19:42.918805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:19:42.918805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:19:42.918805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:19:42.918805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:42.918805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:42.918805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 616/1217] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:42.923273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c63a6-3266-4ed5-bb6a-d6e979bfc3ce None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:43.021938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c63a6-3266-4ed5-bb6a-d6e979bfc3ce None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:43.045953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:43.057229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a87ce-f357-46b3-9965-18496cee6932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:43.057888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a87ce-f357-46b3-9965-18496cee6932 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:43.058171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a87ce-f357-46b3-9965-18496cee6932 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:43.058446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a87ce-f357-46b3-9965-18496cee6932 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:43.059694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a87ce-f357-46b3-9965-18496cee6932 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:43.060009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a87ce-f357-46b3-9965-18496cee6932 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:43.061485 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a87ce-f357-46b3-9965-18496cee6932 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:43.072806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 602/1218] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:43.079707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6521f-a6d1-40a8-8bb1-60f29e97ab70 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:43.182261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b6521f-a6d1-40a8-8bb1-60f29e97ab70 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:43.210691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:43.217412 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82d574-74e7-43f5-be56-e41311881105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:43.218065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d574-74e7-43f5-be56-e41311881105 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:43.218350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d574-74e7-43f5-be56-e41311881105 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:43.218623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d574-74e7-43f5-be56-e41311881105 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:43.219493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d574-74e7-43f5-be56-e41311881105 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=762b38d08d2447bfbc968245a5b2915f) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:43.219804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d574-74e7-43f5-be56-e41311881105 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:43.221286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d574-74e7-43f5-be56-e41311881105 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:43.226622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 617/1219] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:19:43 2022] GET /identity/v3/role_assignments?user.id=762b38d08d2447bfbc968245a5b2915f&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:45.394739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75d47-6a0e-4163-9e0b-cf492a7db6e6 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:45.395313 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75d47-6a0e-4163-9e0b-cf492a7db6e6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:45.395313 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb75d47-6a0e-4163-9e0b-cf492a7db6e6 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:45.396700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 603/1220] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:19:45.401934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2da8-da6c-410d-b937-b18a12517a54 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:45.402321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2da8-da6c-410d-b937-b18a12517a54 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:45.402522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0f2da8-da6c-410d-b937-b18a12517a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:45.420358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ae0f2da8-da6c-410d-b937-b18a12517a54 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:19:45.421575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ae0f2da8-da6c-410d-b937-b18a12517a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:19:45.487428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 618/1221] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:19:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:19:45.510626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75d47-6a0e-4163-9e0b-cf492a7db6e6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:45.612935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb75d47-6a0e-4163-9e0b-cf492a7db6e6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:45.649912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b67b8-36c3-4045-88e0-64ec9ec2f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:45.650633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b67b8-36c3-4045-88e0-64ec9ec2f0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:45.650920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b67b8-36c3-4045-88e0-64ec9ec2f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:45.651197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b67b8-36c3-4045-88e0-64ec9ec2f0c2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:45.661992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b67b8-36c3-4045-88e0-64ec9ec2f0c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e54b67b8-36c3-4045-88e0-64ec9ec2f0c2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:19:45.670847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:45.672087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:45.680696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 604/1222] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:19:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:45.681619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2da8-da6c-410d-b937-b18a12517a54 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:45.773867 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0f2da8-da6c-410d-b937-b18a12517a54 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:45.797455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:45.807524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b949-d198-41a1-a6db-22e88cabc677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:45.808179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b949-d198-41a1-a6db-22e88cabc677 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:45.808464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b949-d198-41a1-a6db-22e88cabc677 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:45.809031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b709b949-d198-41a1-a6db-22e88cabc677 None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:45.813257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709b949-d198-41a1-a6db-22e88cabc677 None admin] RBAC: Adding query filter params (name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:45.813257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709b949-d198-41a1-a6db-22e88cabc677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:45.813257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b709b949-d198-41a1-a6db-22e88cabc677 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:45.819176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 619/1223] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:19:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:45.825509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b67b8-36c3-4045-88e0-64ec9ec2f0c2 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:45.870361 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:45.925174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b67b8-36c3-4045-88e0-64ec9ec2f0c2 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:45.957342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b049e5-81d7-404e-8178-74bd31b77ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:45.958155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b049e5-81d7-404e-8178-74bd31b77ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:45.958511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b049e5-81d7-404e-8178-74bd31b77ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:45.958787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b049e5-81d7-404e-8178-74bd31b77ab5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:45.970120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b049e5-81d7-404e-8178-74bd31b77ab5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:45.971546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b049e5-81d7-404e-8178-74bd31b77ab5 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-70b049e5-81d7-404e-8178-74bd31b77ab5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:45.988210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:45.989329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:45.991359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:45.991359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:45.991359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:45.991359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:45.991359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 605/1224] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:45.995185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b949-d198-41a1-a6db-22e88cabc677 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:46.093943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b709b949-d198-41a1-a6db-22e88cabc677 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:46.127308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138abcbb-c757-4d6c-bd98-47ab35120131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:46.127967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138abcbb-c757-4d6c-bd98-47ab35120131 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:46.128247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138abcbb-c757-4d6c-bd98-47ab35120131 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:46.128617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138abcbb-c757-4d6c-bd98-47ab35120131 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:46.129372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138abcbb-c757-4d6c-bd98-47ab35120131 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:46.129675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138abcbb-c757-4d6c-bd98-47ab35120131 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:46.131048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138abcbb-c757-4d6c-bd98-47ab35120131 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:46.143375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 620/1225] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:46.149193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b049e5-81d7-404e-8178-74bd31b77ab5 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:46.241060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:46.248109 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b049e5-81d7-404e-8178-74bd31b77ab5 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:46.281955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad363a9a-3472-4290-871e-300e2e212e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:46.282746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad363a9a-3472-4290-871e-300e2e212e07 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:46.283026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad363a9a-3472-4290-871e-300e2e212e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:46.283298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad363a9a-3472-4290-871e-300e2e212e07 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:46.290217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad363a9a-3472-4290-871e-300e2e212e07 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:46.291643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad363a9a-3472-4290-871e-300e2e212e07 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-ad363a9a-3472-4290-871e-300e2e212e07 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:19:46.306026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:46.306968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:46.307954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 606/1226] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:46.313688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138abcbb-c757-4d6c-bd98-47ab35120131 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:46.358746 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:46.409896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138abcbb-c757-4d6c-bd98-47ab35120131 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:46.442832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa921c00-6acf-48b1-966a-07cabbe0f885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:46.443496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921c00-6acf-48b1-966a-07cabbe0f885 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:46.443780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921c00-6acf-48b1-966a-07cabbe0f885 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:46.444053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa921c00-6acf-48b1-966a-07cabbe0f885 None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:46.444908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa921c00-6acf-48b1-966a-07cabbe0f885 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:46.445216 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa921c00-6acf-48b1-966a-07cabbe0f885 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:46.446674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa921c00-6acf-48b1-966a-07cabbe0f885 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:46.463612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 621/1227] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 07:19:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:46.469597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad363a9a-3472-4290-871e-300e2e212e07 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:46.567442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad363a9a-3472-4290-871e-300e2e212e07 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:46.601447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0666b-f06b-4757-b0ec-11363a8eeb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:46.603528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0666b-f06b-4757-b0ec-11363a8eeb88 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:46.603528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0666b-f06b-4757-b0ec-11363a8eeb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:46.603528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b0666b-f06b-4757-b0ec-11363a8eeb88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:46.612922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0666b-f06b-4757-b0ec-11363a8eeb88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:46.614367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b0666b-f06b-4757-b0ec-11363a8eeb88 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-b2b0666b-f06b-4757-b0ec-11363a8eeb88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:46.631836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:46.632966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:46.634128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:46.634128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:46.634128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:46.634128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:46.634128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 607/1228] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:46.639321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa921c00-6acf-48b1-966a-07cabbe0f885 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:46.734878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa921c00-6acf-48b1-966a-07cabbe0f885 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:46.737186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:46.767557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa535f-3112-47ba-95de-07172c104c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:46.768208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa535f-3112-47ba-95de-07172c104c59 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:46.768506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa535f-3112-47ba-95de-07172c104c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:46.768789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaa535f-3112-47ba-95de-07172c104c59 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:46.769529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa535f-3112-47ba-95de-07172c104c59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:46.769800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa535f-3112-47ba-95de-07172c104c59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:46.771168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaa535f-3112-47ba-95de-07172c104c59 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:46.782817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 622/1229] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:46.788383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0666b-f06b-4757-b0ec-11363a8eeb88 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:46.797890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:46.886200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b0666b-f06b-4757-b0ec-11363a8eeb88 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:46.919896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe587a-2ffa-48eb-a091-082f29f81c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:46.920711 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe587a-2ffa-48eb-a091-082f29f81c82 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:46.920995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe587a-2ffa-48eb-a091-082f29f81c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:46.921269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fe587a-2ffa-48eb-a091-082f29f81c82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:46.927754 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe587a-2ffa-48eb-a091-082f29f81c82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:46.929280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fe587a-2ffa-48eb-a091-082f29f81c82 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-21fe587a-2ffa-48eb-a091-082f29f81c82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:19:46.943426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:46.944525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:46.945663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:19:46.945663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:19:46.945663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:19:46.945663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:19:46.945663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:19:46.945663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:19:46.945663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:46.945663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:46.945663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 608/1230] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:19:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:46.950447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa535f-3112-47ba-95de-07172c104c59 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:47.048295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaa535f-3112-47ba-95de-07172c104c59 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:47.080071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c57ce-a30c-4d6c-8a2c-de25436115f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:47.080743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c57ce-a30c-4d6c-8a2c-de25436115f9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:47.081023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c57ce-a30c-4d6c-8a2c-de25436115f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:47.081297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c57ce-a30c-4d6c-8a2c-de25436115f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:47.082078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c57ce-a30c-4d6c-8a2c-de25436115f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:47.082385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c57ce-a30c-4d6c-8a2c-de25436115f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:47.083937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c57ce-a30c-4d6c-8a2c-de25436115f9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:47.096633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 623/1231] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:19:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:47.102707 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe587a-2ffa-48eb-a091-082f29f81c82 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:47.168011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:47.201320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fe587a-2ffa-48eb-a091-082f29f81c82 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:47.234983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3ca0c9-e1dd-4bca-be5a-5167fbbee1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:47.235864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca0c9-e1dd-4bca-be5a-5167fbbee1e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:47.236144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca0c9-e1dd-4bca-be5a-5167fbbee1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:47.236421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3ca0c9-e1dd-4bca-be5a-5167fbbee1e9 None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/762b38d08d2447bfbc968245a5b2915f/roles/94ab939081724a88a65a1961cc1826b8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:47.251021 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ca0c9-e1dd-4bca-be5a-5167fbbee1e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=762b38d08d2447bfbc968245a5b2915f, role_id=94ab939081724a88a65a1961cc1826b8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:47.252447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3ca0c9-e1dd-4bca-be5a-5167fbbee1e9 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:47.347710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 609/1232] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:19:47 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/762b38d08d2447bfbc968245a5b2915f/roles/94ab939081724a88a65a1961cc1826b8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:19:49.498558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be45b4-d27f-4a89-b3ff-1234314a139a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:49.499108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be45b4-d27f-4a89-b3ff-1234314a139a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:49.499108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1be45b4-d27f-4a89-b3ff-1234314a139a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:49.500458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 624/1233] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:19:49.505791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566fe0b-4889-4f0c-957c-213b730853ff None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:49.506203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566fe0b-4889-4f0c-957c-213b730853ff None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:49.506389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f566fe0b-4889-4f0c-957c-213b730853ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:49.523082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f566fe0b-4889-4f0c-957c-213b730853ff None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:19:49.524351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f566fe0b-4889-4f0c-957c-213b730853ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:19:49.592600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 610/1234] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:19:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:19:49.616878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be45b4-d27f-4a89-b3ff-1234314a139a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:49.641638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:49.714386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1be45b4-d27f-4a89-b3ff-1234314a139a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:49.748453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c2e2d-f4d2-47f2-8078-052ddb816a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:49.749494 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c2e2d-f4d2-47f2-8078-052ddb816a86 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:49.749726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c2e2d-f4d2-47f2-8078-052ddb816a86 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:49.749997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c2e2d-f4d2-47f2-8078-052ddb816a86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:49.760003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c2e2d-f4d2-47f2-8078-052ddb816a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-522c2e2d-f4d2-47f2-8078-052ddb816a86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:19:49.768379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:49.773913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:49.774956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 625/1235] 10.222.0.24 () {56 vars in 1102 bytes} [Wed May 25 07:19:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:49.775713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566fe0b-4889-4f0c-957c-213b730853ff None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:49.823163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:49.873939 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f566fe0b-4889-4f0c-957c-213b730853ff None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:49.906492 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f30da9-42a6-4b8e-bd6b-a0e8dc5b7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:49.907345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f30da9-42a6-4b8e-bd6b-a0e8dc5b7d69 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:49.907854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f30da9-42a6-4b8e-bd6b-a0e8dc5b7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:49.908524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f30da9-42a6-4b8e-bd6b-a0e8dc5b7d69 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:49.909399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f30da9-42a6-4b8e-bd6b-a0e8dc5b7d69 None admin] RBAC: Adding query filter params (name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:49.909718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f30da9-42a6-4b8e-bd6b-a0e8dc5b7d69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:49.911155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f30da9-42a6-4b8e-bd6b-a0e8dc5b7d69 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:49.919143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 611/1236] 10.222.0.24 () {56 vars in 1103 bytes} [Wed May 25 07:19:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:49.925086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c2e2d-f4d2-47f2-8078-052ddb816a86 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:50.007260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:50.023004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c2e2d-f4d2-47f2-8078-052ddb816a86 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:50.054955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54205eb-58f8-435e-86da-11a7de2449ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:50.055736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54205eb-58f8-435e-86da-11a7de2449ba None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:50.056013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54205eb-58f8-435e-86da-11a7de2449ba None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:50.056284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54205eb-58f8-435e-86da-11a7de2449ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:50.067348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54205eb-58f8-435e-86da-11a7de2449ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:50.068907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54205eb-58f8-435e-86da-11a7de2449ba None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a54205eb-58f8-435e-86da-11a7de2449ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:50.086853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:50.087952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:50.089042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:50.089042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:50.089042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:50.089042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:50.089042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 626/1237] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:19:50.094186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f30da9-42a6-4b8e-bd6b-a0e8dc5b7d69 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:50.193842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f30da9-42a6-4b8e-bd6b-a0e8dc5b7d69 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:50.203278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:50.227953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e66da-8abe-41be-807a-28f87c80e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:50.228647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e66da-8abe-41be-807a-28f87c80e27e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:50.228928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e66da-8abe-41be-807a-28f87c80e27e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:50.229201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e66da-8abe-41be-807a-28f87c80e27e None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:50.229918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e66da-8abe-41be-807a-28f87c80e27e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:50.230222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e66da-8abe-41be-807a-28f87c80e27e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:50.231703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8e66da-8abe-41be-807a-28f87c80e27e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:50.243361 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 612/1238] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:50.249906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54205eb-58f8-435e-86da-11a7de2449ba None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:50.349504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54205eb-58f8-435e-86da-11a7de2449ba None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:50.382114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d14b-feec-45de-bed7-0e89b2d9aca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:50.382914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d14b-feec-45de-bed7-0e89b2d9aca9 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:50.383254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d14b-feec-45de-bed7-0e89b2d9aca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:50.383463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5604d14b-feec-45de-bed7-0e89b2d9aca9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:50.386737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:50.392573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604d14b-feec-45de-bed7-0e89b2d9aca9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:50.394018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5604d14b-feec-45de-bed7-0e89b2d9aca9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-5604d14b-feec-45de-bed7-0e89b2d9aca9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:19:50.407998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:50.409176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:50.410381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 627/1239] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:50.415220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e66da-8abe-41be-807a-28f87c80e27e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:50.514264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e66da-8abe-41be-807a-28f87c80e27e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:50.547733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee801b83-c6c3-4ac7-afab-3ddd2618ef18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:50.548403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee801b83-c6c3-4ac7-afab-3ddd2618ef18 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:50.548719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee801b83-c6c3-4ac7-afab-3ddd2618ef18 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:50.549000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee801b83-c6c3-4ac7-afab-3ddd2618ef18 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:50.549840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee801b83-c6c3-4ac7-afab-3ddd2618ef18 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:50.550154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee801b83-c6c3-4ac7-afab-3ddd2618ef18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:50.551578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee801b83-c6c3-4ac7-afab-3ddd2618ef18 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:50.569351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 613/1240] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 07:19:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:50.575094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d14b-feec-45de-bed7-0e89b2d9aca9 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:50.674193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5604d14b-feec-45de-bed7-0e89b2d9aca9 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:50.706670 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d7965-d9aa-4bb1-ba07-18c783b5d24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:50.707303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d7965-d9aa-4bb1-ba07-18c783b5d24e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:50.707580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d7965-d9aa-4bb1-ba07-18c783b5d24e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:50.707852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61d7965-d9aa-4bb1-ba07-18c783b5d24e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:50.770930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:50.777366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d7965-d9aa-4bb1-ba07-18c783b5d24e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:50.779334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61d7965-d9aa-4bb1-ba07-18c783b5d24e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:50.875187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 628/1241] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:19:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:19:50.881145 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee801b83-c6c3-4ac7-afab-3ddd2618ef18 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:50.908413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:50.977543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee801b83-c6c3-4ac7-afab-3ddd2618ef18 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:51.010159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893229db-de8b-4e72-b6c1-c0efce2f9028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:51.010940 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893229db-de8b-4e72-b6c1-c0efce2f9028 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:51.011220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893229db-de8b-4e72-b6c1-c0efce2f9028 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:51.011489 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893229db-de8b-4e72-b6c1-c0efce2f9028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:51.021250 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893229db-de8b-4e72-b6c1-c0efce2f9028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:51.022689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893229db-de8b-4e72-b6c1-c0efce2f9028 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-893229db-de8b-4e72-b6c1-c0efce2f9028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:51.040849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:51.041881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:51.042871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:51.042871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:51.042871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:51.042871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:51.042871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 614/1242] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:51.048455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d7965-d9aa-4bb1-ba07-18c783b5d24e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:51.142628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:51.148116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61d7965-d9aa-4bb1-ba07-18c783b5d24e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:51.180709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce57802-6198-4d99-8619-fec28ddc5733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:51.181357 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce57802-6198-4d99-8619-fec28ddc5733 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:51.181639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce57802-6198-4d99-8619-fec28ddc5733 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:51.181913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce57802-6198-4d99-8619-fec28ddc5733 None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:51.182624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce57802-6198-4d99-8619-fec28ddc5733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:51.182927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce57802-6198-4d99-8619-fec28ddc5733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:51.184441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce57802-6198-4d99-8619-fec28ddc5733 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:51.195283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 629/1243] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:51.201704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893229db-de8b-4e72-b6c1-c0efce2f9028 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:51.279451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:51.300014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893229db-de8b-4e72-b6c1-c0efce2f9028 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:51.333375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d65d41-a213-43ee-b230-793c69b4a79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:51.334152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d65d41-a213-43ee-b230-793c69b4a79e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:51.335950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d65d41-a213-43ee-b230-793c69b4a79e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:51.335950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d65d41-a213-43ee-b230-793c69b4a79e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:51.342040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d65d41-a213-43ee-b230-793c69b4a79e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:51.343483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d65d41-a213-43ee-b230-793c69b4a79e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-e8d65d41-a213-43ee-b230-793c69b4a79e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:19:51.356821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:51.357865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:51.358985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:19:51.358985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:19:51.358985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:19:51.358985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:19:51.358985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:19:51.358985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:19:51.358985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:51.358985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:51.358985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 615/1244] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:51.363974 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce57802-6198-4d99-8619-fec28ddc5733 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:51.461280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce57802-6198-4d99-8619-fec28ddc5733 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:51.493247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f69f003-57a0-47e7-8dcc-e92712096cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:51.493919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69f003-57a0-47e7-8dcc-e92712096cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:51.494196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69f003-57a0-47e7-8dcc-e92712096cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:51.494497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69f003-57a0-47e7-8dcc-e92712096cc2 None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:51.495242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69f003-57a0-47e7-8dcc-e92712096cc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:51.495547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69f003-57a0-47e7-8dcc-e92712096cc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:51.497511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f69f003-57a0-47e7-8dcc-e92712096cc2 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:51.510091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 630/1245] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:19:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:19:51.517261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d65d41-a213-43ee-b230-793c69b4a79e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:51.616370 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d65d41-a213-43ee-b230-793c69b4a79e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:51.650382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb62e2-0f77-4eda-b502-07a3124a4553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:51.651033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb62e2-0f77-4eda-b502-07a3124a4553 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:51.651315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb62e2-0f77-4eda-b502-07a3124a4553 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:51.651614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb62e2-0f77-4eda-b502-07a3124a4553 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:51.652517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb62e2-0f77-4eda-b502-07a3124a4553 None admin] RBAC: Adding query filter params (role.id=94ab939081724a88a65a1961cc1826b8, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=762b38d08d2447bfbc968245a5b2915f) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:51.652937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb62e2-0f77-4eda-b502-07a3124a4553 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:51.654362 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cb62e2-0f77-4eda-b502-07a3124a4553 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:51.660124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 616/1246] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:19:51 2022] GET /identity/v3/role_assignments?user.id=762b38d08d2447bfbc968245a5b2915f&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=94ab939081724a88a65a1961cc1826b8 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:53.955268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85c724-bdf4-49de-8f54-6eb0a760b6df None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:53.955791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85c724-bdf4-49de-8f54-6eb0a760b6df None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:53.956648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a85c724-bdf4-49de-8f54-6eb0a760b6df None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:53.957217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 631/1247] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:19:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:19:53.962338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a33cab-c2ed-44d6-b779-8928fd7f66c1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:53.962712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a33cab-c2ed-44d6-b779-8928fd7f66c1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:53.962902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a33cab-c2ed-44d6-b779-8928fd7f66c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:53.969274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:53.982200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-72a33cab-c2ed-44d6-b779-8928fd7f66c1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:19:53.983420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-72a33cab-c2ed-44d6-b779-8928fd7f66c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:19:54.049618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 617/1248] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:19:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:19:54.073621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85c724-bdf4-49de-8f54-6eb0a760b6df None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:54.092291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:54.173313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a85c724-bdf4-49de-8f54-6eb0a760b6df None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:54.206088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6985c5-7ccf-40cf-86da-403ad15a890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:54.206813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6985c5-7ccf-40cf-86da-403ad15a890c None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:54.207089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6985c5-7ccf-40cf-86da-403ad15a890c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:54.207358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6985c5-7ccf-40cf-86da-403ad15a890c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:54.217837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6985c5-7ccf-40cf-86da-403ad15a890c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-cc6985c5-7ccf-40cf-86da-403ad15a890c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:19:54.225374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:54.236015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:54.237139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 632/1249] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:54.238054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a33cab-c2ed-44d6-b779-8928fd7f66c1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:54.330782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a33cab-c2ed-44d6-b779-8928fd7f66c1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:54.360145 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:54.364881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a7db8-fb19-4e0c-9034-a3604612e055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:54.365545 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a7db8-fb19-4e0c-9034-a3604612e055 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:54.365828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a7db8-fb19-4e0c-9034-a3604612e055 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:54.366102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1a7db8-fb19-4e0c-9034-a3604612e055 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:54.366846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a7db8-fb19-4e0c-9034-a3604612e055 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:54.367155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a7db8-fb19-4e0c-9034-a3604612e055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:54.368533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1a7db8-fb19-4e0c-9034-a3604612e055 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:54.376548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 618/1250] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:54.382380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6985c5-7ccf-40cf-86da-403ad15a890c None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:54.460849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:54.483112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6985c5-7ccf-40cf-86da-403ad15a890c None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:54.515705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649272e-c3fb-4da5-a440-c970dafd2fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:54.516514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649272e-c3fb-4da5-a440-c970dafd2fc4 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:54.516797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649272e-c3fb-4da5-a440-c970dafd2fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:54.517069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649272e-c3fb-4da5-a440-c970dafd2fc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:54.527131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649272e-c3fb-4da5-a440-c970dafd2fc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:54.528796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5649272e-c3fb-4da5-a440-c970dafd2fc4 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-5649272e-c3fb-4da5-a440-c970dafd2fc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:54.545074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:54.546151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:54.547057 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:54.547057 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:54.547057 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:54.547057 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:54.547057 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 633/1251] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:54.551973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a7db8-fb19-4e0c-9034-a3604612e055 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:54.653516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1a7db8-fb19-4e0c-9034-a3604612e055 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:54.686328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c1d56-d172-4643-9fe8-f473310fa367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:54.686981 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1d56-d172-4643-9fe8-f473310fa367 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:54.687264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1d56-d172-4643-9fe8-f473310fa367 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:54.689013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2c1d56-d172-4643-9fe8-f473310fa367 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:54.689013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c1d56-d172-4643-9fe8-f473310fa367 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:54.689013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c1d56-d172-4643-9fe8-f473310fa367 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:54.689933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2c1d56-d172-4643-9fe8-f473310fa367 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:54.701973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 619/1252] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:54.707668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649272e-c3fb-4da5-a440-c970dafd2fc4 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:54.804144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649272e-c3fb-4da5-a440-c970dafd2fc4 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:54.829894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:54.837423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a1be-507a-4a38-a048-3dca7e46cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:54.838219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a1be-507a-4a38-a048-3dca7e46cdab None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:54.838500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a1be-507a-4a38-a048-3dca7e46cdab None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:54.838771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a1be-507a-4a38-a048-3dca7e46cdab None admin] PATH_INFO: `/v3/users/placement` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:54.846381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a1be-507a-4a38-a048-3dca7e46cdab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:54.847842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a1be-507a-4a38-a048-3dca7e46cdab None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-4679a1be-507a-4a38-a048-3dca7e46cdab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:19:54.862017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:54.863141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:54.864300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 634/1253] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:54.869074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c1d56-d172-4643-9fe8-f473310fa367 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:54.925109 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:54.968175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2c1d56-d172-4643-9fe8-f473310fa367 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:55.001695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d869b29-f136-4ed5-a264-75ccaac95b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:55.002357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d869b29-f136-4ed5-a264-75ccaac95b04 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:55.002640 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d869b29-f136-4ed5-a264-75ccaac95b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:55.002913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d869b29-f136-4ed5-a264-75ccaac95b04 None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:55.003747 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d869b29-f136-4ed5-a264-75ccaac95b04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:55.004056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d869b29-f136-4ed5-a264-75ccaac95b04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:55.005517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d869b29-f136-4ed5-a264-75ccaac95b04 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:55.022991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 620/1254] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 07:19:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:55.030569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a1be-507a-4a38-a048-3dca7e46cdab None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:55.125597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a1be-507a-4a38-a048-3dca7e46cdab None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:55.157213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c8f1-814c-4704-abd3-7c0bcc574f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:55.157853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c8f1-814c-4704-abd3-7c0bcc574f87 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:55.158134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c8f1-814c-4704-abd3-7c0bcc574f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:55.158407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b67c8f1-814c-4704-abd3-7c0bcc574f87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:55.218165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:55.230277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67c8f1-814c-4704-abd3-7c0bcc574f87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:55.232615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b67c8f1-814c-4704-abd3-7c0bcc574f87 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:55.326963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 635/1255] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:19:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:19:55.332782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d869b29-f136-4ed5-a264-75ccaac95b04 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:55.431611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d869b29-f136-4ed5-a264-75ccaac95b04 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:55.444585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:55.464458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f6f1-7119-480c-81ae-d2f47b03e5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:55.465973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f6f1-7119-480c-81ae-d2f47b03e5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:55.466263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f6f1-7119-480c-81ae-d2f47b03e5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:55.466540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5848f6f1-7119-480c-81ae-d2f47b03e5a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:55.476965 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848f6f1-7119-480c-81ae-d2f47b03e5a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:55.478566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5848f6f1-7119-480c-81ae-d2f47b03e5a8 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-5848f6f1-7119-480c-81ae-d2f47b03e5a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:55.496523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:55.500710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:55.501820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:55.501820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:55.501820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:55.501820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:55.501820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 621/1256] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:55.503474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c8f1-814c-4704-abd3-7c0bcc574f87 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:55.588247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:55.600810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b67c8f1-814c-4704-abd3-7c0bcc574f87 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:55.633667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf11b55-67a3-4af8-b04f-c3c4244f200f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:55.634314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11b55-67a3-4af8-b04f-c3c4244f200f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:55.634591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11b55-67a3-4af8-b04f-c3c4244f200f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:55.634861 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf11b55-67a3-4af8-b04f-c3c4244f200f None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:55.635565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf11b55-67a3-4af8-b04f-c3c4244f200f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:55.635865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf11b55-67a3-4af8-b04f-c3c4244f200f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:55.637922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf11b55-67a3-4af8-b04f-c3c4244f200f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:55.648572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 636/1257] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:55.654938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f6f1-7119-480c-81ae-d2f47b03e5a8 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:55.751320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5848f6f1-7119-480c-81ae-d2f47b03e5a8 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:55.785403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf135f-baa1-425b-aab0-dcbba1a9b5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:55.786214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf135f-baa1-425b-aab0-dcbba1a9b5f6 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:55.786498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf135f-baa1-425b-aab0-dcbba1a9b5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:55.786775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf135f-baa1-425b-aab0-dcbba1a9b5f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:55.793544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf135f-baa1-425b-aab0-dcbba1a9b5f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:55.794981 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf135f-baa1-425b-aab0-dcbba1a9b5f6 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-0abf135f-baa1-425b-aab0-dcbba1a9b5f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:19:55.809204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:55.817218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:55.818365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:19:55.818365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:19:55.818365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:19:55.818365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:19:55.818365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:19:55.818365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:19:55.818365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:55.818365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:19:55.818365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 622/1258] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:19:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:55.818897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf11b55-67a3-4af8-b04f-c3c4244f200f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:55.916322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf11b55-67a3-4af8-b04f-c3c4244f200f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:55.948380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17270bf2-25cb-4c49-bb1a-f82ffe6b50ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:55.949081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270bf2-25cb-4c49-bb1a-f82ffe6b50ea None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:55.949364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270bf2-25cb-4c49-bb1a-f82ffe6b50ea None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:55.950209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17270bf2-25cb-4c49-bb1a-f82ffe6b50ea None admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:55.951009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17270bf2-25cb-4c49-bb1a-f82ffe6b50ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:55.951344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17270bf2-25cb-4c49-bb1a-f82ffe6b50ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:55.952815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17270bf2-25cb-4c49-bb1a-f82ffe6b50ea None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:55.964440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 637/1259] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:19:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:55.971409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf135f-baa1-425b-aab0-dcbba1a9b5f6 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:55.999141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:56.071856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf135f-baa1-425b-aab0-dcbba1a9b5f6 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:56.105116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf797be-336d-4566-aeea-007bb398ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:56.105765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf797be-336d-4566-aeea-007bb398ed40 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:56.106051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf797be-336d-4566-aeea-007bb398ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:56.106332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf797be-336d-4566-aeea-007bb398ed40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:56.107208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf797be-336d-4566-aeea-007bb398ed40 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=762b38d08d2447bfbc968245a5b2915f) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:56.107763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf797be-336d-4566-aeea-007bb398ed40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:56.110245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf797be-336d-4566-aeea-007bb398ed40 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:56.115654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 623/1260] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:19:55 2022] GET /identity/v3/role_assignments?user.id=762b38d08d2447bfbc968245a5b2915f&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=7c09d078126441909df0a46212ffea63 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:19:58.313802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148ee8d-b3ae-4e29-971a-c9333970ad82 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:58.314341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148ee8d-b3ae-4e29-971a-c9333970ad82 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:58.314341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148ee8d-b3ae-4e29-971a-c9333970ad82 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:58.315691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 638/1261] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:19:58.320970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a7e54-054c-44ad-80ac-0788852cb0b9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:58.321434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a7e54-054c-44ad-80ac-0788852cb0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:58.321527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a7e54-054c-44ad-80ac-0788852cb0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:58.338085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ca8a7e54-054c-44ad-80ac-0788852cb0b9 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:19:58.339255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ca8a7e54-054c-44ad-80ac-0788852cb0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:19:58.405576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 624/1262] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:19:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:19:58.428559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148ee8d-b3ae-4e29-971a-c9333970ad82 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:58.439357 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:58.527096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148ee8d-b3ae-4e29-971a-c9333970ad82 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:58.561043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b761-99a2-4b56-a970-928b406f702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:58.561828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b761-99a2-4b56-a970-928b406f702b None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:58.562104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b761-99a2-4b56-a970-928b406f702b None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:58.562371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275b761-99a2-4b56-a970-928b406f702b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:58.579471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275b761-99a2-4b56-a970-928b406f702b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-3275b761-99a2-4b56-a970-928b406f702b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:19:58.579916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:58.581101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:58.582418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 639/1263] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:58.587476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a7e54-054c-44ad-80ac-0788852cb0b9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:58.607921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:58.685303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a7e54-054c-44ad-80ac-0788852cb0b9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:58.719222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb01a5-c713-46c7-9981-35ea0daab335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:58.719880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb01a5-c713-46c7-9981-35ea0daab335 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:58.720162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb01a5-c713-46c7-9981-35ea0daab335 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:58.720436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb01a5-c713-46c7-9981-35ea0daab335 None admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:58.721211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb01a5-c713-46c7-9981-35ea0daab335 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:58.721517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb01a5-c713-46c7-9981-35ea0daab335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:58.722896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb01a5-c713-46c7-9981-35ea0daab335 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:58.730766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 625/1264] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:58.738906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b761-99a2-4b56-a970-928b406f702b None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:58.811682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:58.844748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275b761-99a2-4b56-a970-928b406f702b None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:58.879832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe83ad-4fdc-46e9-b143-24523a63619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:58.880655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe83ad-4fdc-46e9-b143-24523a63619f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:58.880940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe83ad-4fdc-46e9-b143-24523a63619f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:58.881221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe83ad-4fdc-46e9-b143-24523a63619f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:58.892055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe83ad-4fdc-46e9-b143-24523a63619f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:58.893648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe83ad-4fdc-46e9-b143-24523a63619f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-4bbe83ad-4fdc-46e9-b143-24523a63619f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:58.911119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:58.918853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:58.920922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:58.920922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:58.920922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:58.920922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:58.920922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 640/1265] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:58.921488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb01a5-c713-46c7-9981-35ea0daab335 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:59.004323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:59.022570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb01a5-c713-46c7-9981-35ea0daab335 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:59.055464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85824adc-1f52-442e-827f-b4b1b61d907b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:59.056114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85824adc-1f52-442e-827f-b4b1b61d907b None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:59.056396 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85824adc-1f52-442e-827f-b4b1b61d907b None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:59.056702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85824adc-1f52-442e-827f-b4b1b61d907b None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:59.057418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85824adc-1f52-442e-827f-b4b1b61d907b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:59.057724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85824adc-1f52-442e-827f-b4b1b61d907b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:59.059080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85824adc-1f52-442e-827f-b4b1b61d907b None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:59.070010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 626/1266] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:59.075689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe83ad-4fdc-46e9-b143-24523a63619f None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:59.173467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe83ad-4fdc-46e9-b143-24523a63619f None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:59.192001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:59.205471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a3341-2760-47f6-8086-f5a4b18e773e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:59.206263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a3341-2760-47f6-8086-f5a4b18e773e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:59.206542 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a3341-2760-47f6-8086-f5a4b18e773e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:59.206813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a3341-2760-47f6-8086-f5a4b18e773e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:59.216350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a3341-2760-47f6-8086-f5a4b18e773e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:59.219165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a3341-2760-47f6-8086-f5a4b18e773e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-b17a3341-2760-47f6-8086-f5a4b18e773e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:19:59.232950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:59.234140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:59.235158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 641/1267] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:59.239941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85824adc-1f52-442e-827f-b4b1b61d907b None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:59.337446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85824adc-1f52-442e-827f-b4b1b61d907b None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:59.370833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19f315-141c-4c27-a86e-a84856d0359e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:59.371490 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19f315-141c-4c27-a86e-a84856d0359e None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:59.371767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19f315-141c-4c27-a86e-a84856d0359e None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:59.372039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19f315-141c-4c27-a86e-a84856d0359e None admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:59.372943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19f315-141c-4c27-a86e-a84856d0359e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:59.373342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19f315-141c-4c27-a86e-a84856d0359e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:59.374918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19f315-141c-4c27-a86e-a84856d0359e None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:59.383807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:59.392385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 627/1268] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 07:19:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:59.398079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a3341-2760-47f6-8086-f5a4b18e773e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:59.495351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a3341-2760-47f6-8086-f5a4b18e773e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:59.527038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cf76e-de23-496a-9b5a-61cc2d8c1a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:59.527810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cf76e-de23-496a-9b5a-61cc2d8c1a13 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:59.528085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cf76e-de23-496a-9b5a-61cc2d8c1a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:59.528383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6cf76e-de23-496a-9b5a-61cc2d8c1a13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:59.539099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cf76e-de23-496a-9b5a-61cc2d8c1a13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:59.540640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6cf76e-de23-496a-9b5a-61cc2d8c1a13 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-ca6cf76e-de23-496a-9b5a-61cc2d8c1a13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:19:59.557961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:59.559072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:59.560018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:19:59.560018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:19:59.560018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:19:59.560018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:59.560018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 642/1269] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:59.565322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19f315-141c-4c27-a86e-a84856d0359e None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:59.664688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19f315-141c-4c27-a86e-a84856d0359e None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:59.697203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08bca7-9119-4b31-8f22-b559e35319a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:59.697855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08bca7-9119-4b31-8f22-b559e35319a7 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:59.698139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08bca7-9119-4b31-8f22-b559e35319a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:59.698417 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08bca7-9119-4b31-8f22-b559e35319a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:59.699136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08bca7-9119-4b31-8f22-b559e35319a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:19:59.699442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08bca7-9119-4b31-8f22-b559e35319a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:59.700833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08bca7-9119-4b31-8f22-b559e35319a7 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:59.712284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 628/1270] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:19:59.719071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cf76e-de23-496a-9b5a-61cc2d8c1a13 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:59.750457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:59.816132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6cf76e-de23-496a-9b5a-61cc2d8c1a13 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:19:59.849133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20570750-0ddc-4648-9981-bc76fd0196de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:19:59.849943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20570750-0ddc-4648-9981-bc76fd0196de None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:19:59.850223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20570750-0ddc-4648-9981-bc76fd0196de None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:19:59.850495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20570750-0ddc-4648-9981-bc76fd0196de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:19:59.857086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20570750-0ddc-4648-9981-bc76fd0196de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:19:59.859315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20570750-0ddc-4648-9981-bc76fd0196de None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-20570750-0ddc-4648-9981-bc76fd0196de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:19:59.874004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:19:59.875113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:19:59.876187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:19:59.876187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:19:59.876187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:19:59.876187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:19:59.876187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:19:59.876187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:19:59.876187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:19:59.876187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:19:59.876187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 643/1271] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:19:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:19:59.881251 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08bca7-9119-4b31-8f22-b559e35319a7 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:19:59.938805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:19:59.979798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08bca7-9119-4b31-8f22-b559e35319a7 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:00.016795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b85043-e37e-4621-8de2-320a392e7efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:00.017389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b85043-e37e-4621-8de2-320a392e7efa None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:00.017675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b85043-e37e-4621-8de2-320a392e7efa None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:00.017953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b85043-e37e-4621-8de2-320a392e7efa None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:00.018774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b85043-e37e-4621-8de2-320a392e7efa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:00.019091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b85043-e37e-4621-8de2-320a392e7efa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:00.020600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b85043-e37e-4621-8de2-320a392e7efa None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:00.032632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 629/1272] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:19:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:00.038662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20570750-0ddc-4648-9981-bc76fd0196de None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:00.131882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:00.140080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20570750-0ddc-4648-9981-bc76fd0196de None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:00.172457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb7389-d9a9-4744-be6b-21991239f2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:00.173363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb7389-d9a9-4744-be6b-21991239f2b9 None admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:00.173644 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb7389-d9a9-4744-be6b-21991239f2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:00.173919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb7389-d9a9-4744-be6b-21991239f2b9 None admin] PATH_INFO: `/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/762b38d08d2447bfbc968245a5b2915f/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:00.175831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb7389-d9a9-4744-be6b-21991239f2b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=25a3ada0467e494b92c3480826a53ab3, user_id=762b38d08d2447bfbc968245a5b2915f, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:00.177362 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb7389-d9a9-4744-be6b-21991239f2b9 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:00.256756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 644/1273] 10.222.0.24 () {58 vars in 1439 bytes} [Wed May 25 07:20:00 2022] PUT /identity/v3/projects/25a3ada0467e494b92c3480826a53ab3/users/762b38d08d2447bfbc968245a5b2915f/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:20:02.436290 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cdf33-51be-4ecc-930f-12503ddce194 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:02.436940 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cdf33-51be-4ecc-930f-12503ddce194 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:02.437036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cdf33-51be-4ecc-930f-12503ddce194 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:02.438433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 630/1274] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:20:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:20:02.443556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ad54a-b01a-4833-99c6-ffcc1c0c99b8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:02.449220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ad54a-b01a-4833-99c6-ffcc1c0c99b8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:02.449220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ad54a-b01a-4833-99c6-ffcc1c0c99b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:02.460394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-415ad54a-b01a-4833-99c6-ffcc1c0c99b8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:20:02.461635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-415ad54a-b01a-4833-99c6-ffcc1c0c99b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:20:02.527337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 645/1275] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:20:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:20:02.551457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cdf33-51be-4ecc-930f-12503ddce194 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:02.652347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cdf33-51be-4ecc-930f-12503ddce194 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:02.669292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:02.687128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb453525-3ab5-4497-8716-c6707bd9489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:02.687943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb453525-3ab5-4497-8716-c6707bd9489c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:02.688184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb453525-3ab5-4497-8716-c6707bd9489c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:02.688457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb453525-3ab5-4497-8716-c6707bd9489c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:02.698345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb453525-3ab5-4497-8716-c6707bd9489c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-fb453525-3ab5-4497-8716-c6707bd9489c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:20:02.706194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:20:02.708222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:02.709243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 631/1276] 10.222.0.24 () {56 vars in 1096 bytes} [Wed May 25 07:20:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:20:02.713495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ad54a-b01a-4833-99c6-ffcc1c0c99b8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:02.793868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:02.811528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ad54a-b01a-4833-99c6-ffcc1c0c99b8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:02.844181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5d26-031a-4a65-914f-e5e0e042651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:02.844871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5d26-031a-4a65-914f-e5e0e042651e None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:02.845153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5d26-031a-4a65-914f-e5e0e042651e None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:02.845430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2be5d26-031a-4a65-914f-e5e0e042651e None admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:02.846169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be5d26-031a-4a65-914f-e5e0e042651e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:02.846476 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be5d26-031a-4a65-914f-e5e0e042651e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:02.847852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2be5d26-031a-4a65-914f-e5e0e042651e None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:02.855617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 646/1277] 10.222.0.24 () {56 vars in 1099 bytes} [Wed May 25 07:20:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:02.862115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb453525-3ab5-4497-8716-c6707bd9489c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:02.961625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb453525-3ab5-4497-8716-c6707bd9489c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:02.995433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34108d-ce3a-4f84-a7aa-e71e40b37ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:02.996218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34108d-ce3a-4f84-a7aa-e71e40b37ecc None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:02.996556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34108d-ce3a-4f84-a7aa-e71e40b37ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:02.996830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34108d-ce3a-4f84-a7aa-e71e40b37ecc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:03.007161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34108d-ce3a-4f84-a7aa-e71e40b37ecc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:03.008636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34108d-ce3a-4f84-a7aa-e71e40b37ecc None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-7f34108d-ce3a-4f84-a7aa-e71e40b37ecc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:20:03.025135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:20:03.026176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:20:03.027284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:20:03.027284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:20:03.027284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:20:03.027284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:03.027284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 632/1278] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:20:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:20:03.032589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5d26-031a-4a65-914f-e5e0e042651e None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:03.130910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2be5d26-031a-4a65-914f-e5e0e042651e None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:03.164290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696fdbc-c3a4-4d88-8a95-35e3121dfeac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:03.164979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696fdbc-c3a4-4d88-8a95-35e3121dfeac None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:03.165261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696fdbc-c3a4-4d88-8a95-35e3121dfeac None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:03.165534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5696fdbc-c3a4-4d88-8a95-35e3121dfeac None admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:03.166248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696fdbc-c3a4-4d88-8a95-35e3121dfeac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:03.166553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696fdbc-c3a4-4d88-8a95-35e3121dfeac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:03.167937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5696fdbc-c3a4-4d88-8a95-35e3121dfeac None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:03.179330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 647/1279] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:20:03.184978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34108d-ce3a-4f84-a7aa-e71e40b37ecc None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:03.215961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:03.284877 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34108d-ce3a-4f84-a7aa-e71e40b37ecc None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:03.318151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4ca2f-a1b5-401a-9e1a-78d287b2b37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:03.318946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4ca2f-a1b5-401a-9e1a-78d287b2b37c None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:03.319229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4ca2f-a1b5-401a-9e1a-78d287b2b37c None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:03.319504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4ca2f-a1b5-401a-9e1a-78d287b2b37c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:03.326932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4ca2f-a1b5-401a-9e1a-78d287b2b37c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:03.328364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4ca2f-a1b5-401a-9e1a-78d287b2b37c None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-a9c4ca2f-a1b5-401a-9e1a-78d287b2b37c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:20:03.343971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:20:03.345631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:03.346914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 633/1280] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:20:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:20:03.350942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696fdbc-c3a4-4d88-8a95-35e3121dfeac None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:03.354686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:03.448077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5696fdbc-c3a4-4d88-8a95-35e3121dfeac None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:03.482492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dfef8-56ea-4667-9448-36ba6a0474bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:03.483267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dfef8-56ea-4667-9448-36ba6a0474bf None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:03.483545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dfef8-56ea-4667-9448-36ba6a0474bf None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:03.483817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dfef8-56ea-4667-9448-36ba6a0474bf None admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:03.484667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dfef8-56ea-4667-9448-36ba6a0474bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:03.487784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dfef8-56ea-4667-9448-36ba6a0474bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:03.487784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dfef8-56ea-4667-9448-36ba6a0474bf None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:03.503523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 648/1281] 10.222.0.24 () {56 vars in 1143 bytes} [Wed May 25 07:20:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:03.509255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4ca2f-a1b5-401a-9e1a-78d287b2b37c None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:03.610248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:03.620295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4ca2f-a1b5-401a-9e1a-78d287b2b37c None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:03.653040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce23fd5-4b23-49f6-b984-e69a7e8cf8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:03.653687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce23fd5-4b23-49f6-b984-e69a7e8cf8b0 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:03.653970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce23fd5-4b23-49f6-b984-e69a7e8cf8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:03.654831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce23fd5-4b23-49f6-b984-e69a7e8cf8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:03.720057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce23fd5-4b23-49f6-b984-e69a7e8cf8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:03.721548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce23fd5-4b23-49f6-b984-e69a7e8cf8b0 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:03.809476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:03.819441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 634/1282] 10.222.0.24 () {58 vars in 1282 bytes} [Wed May 25 07:20:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:20:03.825356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dfef8-56ea-4667-9448-36ba6a0474bf None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:03.887957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:03.925611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dfef8-56ea-4667-9448-36ba6a0474bf None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:03.959109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b4016-1cc7-4d8a-9d98-abfe34abf155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:03.959907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b4016-1cc7-4d8a-9d98-abfe34abf155 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:03.960236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b4016-1cc7-4d8a-9d98-abfe34abf155 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:03.960539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b4016-1cc7-4d8a-9d98-abfe34abf155 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:03.971690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b4016-1cc7-4d8a-9d98-abfe34abf155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:03.973188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b4016-1cc7-4d8a-9d98-abfe34abf155 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-a46b4016-1cc7-4d8a-9d98-abfe34abf155 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:20:03.990201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:20:03.991296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:20:03.992288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:20:03.992288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:20:03.992288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:20:03.992288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:20:03.992288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 649/1283] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:20:03.997132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce23fd5-4b23-49f6-b984-e69a7e8cf8b0 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:04.094020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce23fd5-4b23-49f6-b984-e69a7e8cf8b0 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:04.128719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52193-76fd-4218-8475-f0fab19d20f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:04.129382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52193-76fd-4218-8475-f0fab19d20f3 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:04.129664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52193-76fd-4218-8475-f0fab19d20f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:04.129939 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa52193-76fd-4218-8475-f0fab19d20f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:04.130660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa52193-76fd-4218-8475-f0fab19d20f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:04.130966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa52193-76fd-4218-8475-f0fab19d20f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:04.132340 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa52193-76fd-4218-8475-f0fab19d20f3 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:04.144154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 635/1284] 10.222.0.24 () {56 vars in 1109 bytes} [Wed May 25 07:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:04.149759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b4016-1cc7-4d8a-9d98-abfe34abf155 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:04.249646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b4016-1cc7-4d8a-9d98-abfe34abf155 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:04.263402 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:04.284213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54f8e8-f595-4bb2-a403-6bca0b3b0349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:04.285031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54f8e8-f595-4bb2-a403-6bca0b3b0349 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:04.285309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54f8e8-f595-4bb2-a403-6bca0b3b0349 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:04.285581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54f8e8-f595-4bb2-a403-6bca0b3b0349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:04.291862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54f8e8-f595-4bb2-a403-6bca0b3b0349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:04.293328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c54f8e8-f595-4bb2-a403-6bca0b3b0349 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application [None req-7c54f8e8-f595-4bb2-a403-6bca0b3b0349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:20:04.306807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application with Lock( May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._enter() May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.creator() May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:20:04.307928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application created_value = creator( May 25 07:20:04.308965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:20:04.308965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:20:04.308965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:20:04.308965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:20:04.308965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:20:04.308965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:20:04.308965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:20:04.308965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: ERROR keystone.server.flask.application May 25 07:20:04.308965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 650/1285] 10.222.0.24 () {56 vars in 1111 bytes} [Wed May 25 07:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:20:04.314648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52193-76fd-4218-8475-f0fab19d20f3 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:04.377025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:04.432681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa52193-76fd-4218-8475-f0fab19d20f3 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:04.465633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29acbc0a-a7b6-45ad-87e5-f1327dfffc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:04.466289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acbc0a-a7b6-45ad-87e5-f1327dfffc62 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:04.466571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acbc0a-a7b6-45ad-87e5-f1327dfffc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:04.466847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29acbc0a-a7b6-45ad-87e5-f1327dfffc62 None admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:04.467908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acbc0a-a7b6-45ad-87e5-f1327dfffc62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:04.468210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acbc0a-a7b6-45ad-87e5-f1327dfffc62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:04.469664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29acbc0a-a7b6-45ad-87e5-f1327dfffc62 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:04.482076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 636/1286] 10.222.0.24 () {56 vars in 1148 bytes} [Wed May 25 07:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:04.488601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54f8e8-f595-4bb2-a403-6bca0b3b0349 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:04.586287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54f8e8-f595-4bb2-a403-6bca0b3b0349 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:04.622576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a39bfe-5d73-4f81-80b6-e72a91023f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:04.623971 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a39bfe-5d73-4f81-80b6-e72a91023f82 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:04.624249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a39bfe-5d73-4f81-80b6-e72a91023f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:04.624539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a39bfe-5d73-4f81-80b6-e72a91023f82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:04.625361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a39bfe-5d73-4f81-80b6-e72a91023f82 None admin] RBAC: Adding query filter params (role.id=7c09d078126441909df0a46212ffea63, scope.project.id=25a3ada0467e494b92c3480826a53ab3, user.id=762b38d08d2447bfbc968245a5b2915f) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:04.625665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a39bfe-5d73-4f81-80b6-e72a91023f82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:04.627290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a39bfe-5d73-4f81-80b6-e72a91023f82 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:04.633005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 651/1287] 10.222.0.24 () {56 vars in 1374 bytes} [Wed May 25 07:20:04 2022] GET /identity/v3/role_assignments?user.id=762b38d08d2447bfbc968245a5b2915f&scope.project.id=25a3ada0467e494b92c3480826a53ab3&role.id=7c09d078126441909df0a46212ffea63 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:06.850758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012baec-7a64-4b36-9063-c2c01290a2d9 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:06.851288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012baec-7a64-4b36-9063-c2c01290a2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:06.851288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c012baec-7a64-4b36-9063-c2c01290a2d9 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:06.852724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 637/1288] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:20:06.858518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304826dc-42b8-408d-836b-437654a7d39b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:06.858964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304826dc-42b8-408d-836b-437654a7d39b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:06.859076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304826dc-42b8-408d-836b-437654a7d39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:06.875694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-304826dc-42b8-408d-836b-437654a7d39b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:20:06.876928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-304826dc-42b8-408d-836b-437654a7d39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:20:06.906688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:06.942804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 652/1289] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:20:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:20:06.965220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012baec-7a64-4b36-9063-c2c01290a2d9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:07.066061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c012baec-7a64-4b36-9063-c2c01290a2d9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:07.077202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:07.100320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582297a-9d11-456d-a5cf-06a02028bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:07.101249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582297a-9d11-456d-a5cf-06a02028bc94 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:07.101506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582297a-9d11-456d-a5cf-06a02028bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:07.101784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6582297a-9d11-456d-a5cf-06a02028bc94 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:07.102447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582297a-9d11-456d-a5cf-06a02028bc94 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:07.103812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6582297a-9d11-456d-a5cf-06a02028bc94 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-6582297a-9d11-456d-a5cf-06a02028bc94 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:20:07.115843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:20:07.117156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:07.118312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 638/1290] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:20:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:20:07.123301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304826dc-42b8-408d-836b-437654a7d39b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:07.223662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304826dc-42b8-408d-836b-437654a7d39b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:07.257165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab025a-f6be-45ee-8a12-2bbbae6ff85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:07.257812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab025a-f6be-45ee-8a12-2bbbae6ff85f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:07.258092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab025a-f6be-45ee-8a12-2bbbae6ff85f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:07.258368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab025a-f6be-45ee-8a12-2bbbae6ff85f None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:07.259122 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab025a-f6be-45ee-8a12-2bbbae6ff85f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:07.259424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab025a-f6be-45ee-8a12-2bbbae6ff85f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:07.260872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab025a-f6be-45ee-8a12-2bbbae6ff85f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:07.269430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 653/1291] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 07:20:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:20:07.272159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582297a-9d11-456d-a5cf-06a02028bc94 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:07.388524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6582297a-9d11-456d-a5cf-06a02028bc94 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:07.422257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1526868-cd4f-40b2-acf0-778c6da92408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:07.422910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1526868-cd4f-40b2-acf0-778c6da92408 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:07.423190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1526868-cd4f-40b2-acf0-778c6da92408 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:07.423462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1526868-cd4f-40b2-acf0-778c6da92408 None admin] PATH_INFO: `/v3/services` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:07.424166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1526868-cd4f-40b2-acf0-778c6da92408 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:07.424469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1526868-cd4f-40b2-acf0-778c6da92408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:07.425845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1526868-cd4f-40b2-acf0-778c6da92408 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:07.430183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 639/1292] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 07:20:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:09.634640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a4435-f799-4750-b7a6-e769065e994f None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:09.635135 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a4435-f799-4750-b7a6-e769065e994f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:09.635245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7a4435-f799-4750-b7a6-e769065e994f None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:09.636552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 654/1293] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:20:09.642316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3fb3-c89b-47c2-a5b9-01db29593510 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:09.642735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3fb3-c89b-47c2-a5b9-01db29593510 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:09.642902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b3fb3-c89b-47c2-a5b9-01db29593510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:09.659797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2d3b3fb3-c89b-47c2-a5b9-01db29593510 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:20:09.661095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2d3b3fb3-c89b-47c2-a5b9-01db29593510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:20:09.690042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:09.735911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 640/1294] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:20:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:20:09.759562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a4435-f799-4750-b7a6-e769065e994f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:09.790626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:09.858188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7a4435-f799-4750-b7a6-e769065e994f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:09.891845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb8df8-dd5c-4c8c-973d-cb8bb6c0015c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:09.892519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb8df8-dd5c-4c8c-973d-cb8bb6c0015c None admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:09.892799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb8df8-dd5c-4c8c-973d-cb8bb6c0015c None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:09.893065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb8df8-dd5c-4c8c-973d-cb8bb6c0015c None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:09.893780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb8df8-dd5c-4c8c-973d-cb8bb6c0015c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:09.895178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb8df8-dd5c-4c8c-973d-cb8bb6c0015c None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:09.964791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 655/1295] 10.222.0.24 () {60 vars in 1141 bytes} [Wed May 25 07:20:09 2022] POST /identity/v3/services => generated 246 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:20:12.159385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488e3cd-0d58-43d6-b05c-8e6f8367e9d3 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:12.159916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488e3cd-0d58-43d6-b05c-8e6f8367e9d3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:12.159916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488e3cd-0d58-43d6-b05c-8e6f8367e9d3 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:12.161345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 641/1296] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:20:12.166580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167852e-a664-430a-9ae1-d17bef227c84 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:12.166984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167852e-a664-430a-9ae1-d17bef227c84 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:12.167124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167852e-a664-430a-9ae1-d17bef227c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:12.184000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f167852e-a664-430a-9ae1-d17bef227c84 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:20:12.185202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f167852e-a664-430a-9ae1-d17bef227c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:20:12.256386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 656/1297] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:20:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:20:12.279373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488e3cd-0d58-43d6-b05c-8e6f8367e9d3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:12.385652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488e3cd-0d58-43d6-b05c-8e6f8367e9d3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:12.418349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c9910-969d-41ad-bc15-7dcb31b80e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:12.419073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c9910-969d-41ad-bc15-7dcb31b80e92 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:12.419351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c9910-969d-41ad-bc15-7dcb31b80e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:12.419622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c9910-969d-41ad-bc15-7dcb31b80e92 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:12.420824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c9910-969d-41ad-bc15-7dcb31b80e92 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:12.422201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337c9910-969d-41ad-bc15-7dcb31b80e92 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-337c9910-969d-41ad-bc15-7dcb31b80e92 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:20:12.433691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:20:12.434968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:12.436749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 642/1298] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:20:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:20:12.441960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167852e-a664-430a-9ae1-d17bef227c84 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:12.460404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:12.538709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167852e-a664-430a-9ae1-d17bef227c84 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:12.572199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4fcae-4fe6-401b-981e-c36cd3fe4d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:12.572889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4fcae-4fe6-401b-981e-c36cd3fe4d03 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:12.573168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4fcae-4fe6-401b-981e-c36cd3fe4d03 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:12.573442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4fcae-4fe6-401b-981e-c36cd3fe4d03 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:12.574141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4fcae-4fe6-401b-981e-c36cd3fe4d03 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:12.574461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4fcae-4fe6-401b-981e-c36cd3fe4d03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:12.575813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4fcae-4fe6-401b-981e-c36cd3fe4d03 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:12.580939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 657/1299] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 07:20:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:12.587025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c9910-969d-41ad-bc15-7dcb31b80e92 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:12.619625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:12.685358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c9910-969d-41ad-bc15-7dcb31b80e92 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:12.719283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebee98f-55af-4178-8ab0-7f5f92aeaae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:12.719934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee98f-55af-4178-8ab0-7f5f92aeaae1 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:12.720229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee98f-55af-4178-8ab0-7f5f92aeaae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:12.720568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebee98f-55af-4178-8ab0-7f5f92aeaae1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:12.721415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee98f-55af-4178-8ab0-7f5f92aeaae1 None admin] RBAC: Adding query filter params (interface=public, service_id=d3471c9a164b493a9782dc54f9521566, region_id=RegionOne) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:12.721723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee98f-55af-4178-8ab0-7f5f92aeaae1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:12.723088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebee98f-55af-4178-8ab0-7f5f92aeaae1 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:12.728170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 643/1300] 10.222.0.24 () {56 vars in 1251 bytes} [Wed May 25 07:20:12 2022] GET /identity/v3/endpoints?service_id=d3471c9a164b493a9782dc54f9521566&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:12.734818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4fcae-4fe6-401b-981e-c36cd3fe4d03 None admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:12.813551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:12.830783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4fcae-4fe6-401b-981e-c36cd3fe4d03 None admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:12.865176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756b10f-c12b-4d8f-9f62-a6d65f52f14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:12.865837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b10f-c12b-4d8f-9f62-a6d65f52f14f None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:12.866122 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b10f-c12b-4d8f-9f62-a6d65f52f14f None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:12.866408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756b10f-c12b-4d8f-9f62-a6d65f52f14f None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:12.867090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756b10f-c12b-4d8f-9f62-a6d65f52f14f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:12.868493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3756b10f-c12b-4d8f-9f62-a6d65f52f14f None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:12.875809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 658/1301] 10.222.0.24 () {56 vars in 1087 bytes} [Wed May 25 07:20:12 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:20:15.104014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2a8a3-8734-4878-9ce9-1648e0d6f1ff None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:15.104584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2a8a3-8734-4878-9ce9-1648e0d6f1ff None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:15.104584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2a8a3-8734-4878-9ce9-1648e0d6f1ff None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:15.106063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 644/1302] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:20:15.111847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57227b-60a9-4af0-98dd-9d2f381f099d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:15.112263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57227b-60a9-4af0-98dd-9d2f381f099d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:15.112448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57227b-60a9-4af0-98dd-9d2f381f099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:15.128953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-dd57227b-60a9-4af0-98dd-9d2f381f099d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:20:15.130187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dd57227b-60a9-4af0-98dd-9d2f381f099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:20:15.195304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 659/1303] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:20:15 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:20:15.219015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2a8a3-8734-4878-9ce9-1648e0d6f1ff None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:15.312231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:15.318790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2a8a3-8734-4878-9ce9-1648e0d6f1ff None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:15.352994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef1b36-3803-4a71-ac23-e66d965e61f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:15.353790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef1b36-3803-4a71-ac23-e66d965e61f4 None admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:15.354119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef1b36-3803-4a71-ac23-e66d965e61f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:15.354356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef1b36-3803-4a71-ac23-e66d965e61f4 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:15.355009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef1b36-3803-4a71-ac23-e66d965e61f4 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:15.356378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef1b36-3803-4a71-ac23-e66d965e61f4 None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application [None req-f8ef1b36-3803-4a71-ac23-e66d965e61f4 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:20:15.368070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:20:15.369257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application with Lock( May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self._enter() May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application return self.creator() May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application created_value = creator( May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: ERROR keystone.server.flask.application May 25 07:20:15.370441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 645/1304] 10.222.0.24 () {56 vars in 1117 bytes} [Wed May 25 07:20:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:20:15.375427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57227b-60a9-4af0-98dd-9d2f381f099d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:15.450215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:15.472385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57227b-60a9-4af0-98dd-9d2f381f099d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:15.504285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba75ef1-e0da-43d9-a36b-a24e27ffb3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:15.504958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba75ef1-e0da-43d9-a36b-a24e27ffb3c3 None admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:15.505236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba75ef1-e0da-43d9-a36b-a24e27ffb3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:15.505507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba75ef1-e0da-43d9-a36b-a24e27ffb3c3 None admin] PATH_INFO: `/v3/services` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:15.506201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba75ef1-e0da-43d9-a36b-a24e27ffb3c3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:20:15.506584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba75ef1-e0da-43d9-a36b-a24e27ffb3c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:15.507961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba75ef1-e0da-43d9-a36b-a24e27ffb3c3 None admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:15.512901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 660/1305] 10.222.0.24 () {56 vars in 1116 bytes} [Wed May 25 07:20:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:20:15.518583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef1b36-3803-4a71-ac23-e66d965e61f4 None admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:20:15.618081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef1b36-3803-4a71-ac23-e66d965e61f4 None admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:20:15.650262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b26191-6dea-49ea-9d26-68d1e974d0cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:20:15.650910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26191-6dea-49ea-9d26-68d1e974d0cd None admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:20:15.651192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26191-6dea-49ea-9d26-68d1e974d0cd None admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:20:15.651465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b26191-6dea-49ea-9d26-68d1e974d0cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:20:15.652220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b26191-6dea-49ea-9d26-68d1e974d0cd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:20:15.653605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b26191-6dea-49ea-9d26-68d1e974d0cd None admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:20:15.753537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 646/1306] 10.222.0.24 () {60 vars in 1144 bytes} [Wed May 25 07:20:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:20:25.558660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=30 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:20:25.749033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:38.082439 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3de002-ddf0-4821-b060-bae448b8e83e None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:38.083455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3de002-ddf0-4821-b060-bae448b8e83e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:38.083973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3de002-ddf0-4821-b060-bae448b8e83e None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:38.091864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de0e48-ed55-4ae5-bde4-72f496ad76b1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:38.097367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de0e48-ed55-4ae5-bde4-72f496ad76b1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:38.097367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de0e48-ed55-4ae5-bde4-72f496ad76b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:38.097596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 661/1307] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:27:38 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:27:38.186248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c2de0e48-ed55-4ae5-bde4-72f496ad76b1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:27:38.188636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c2de0e48-ed55-4ae5-bde4-72f496ad76b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:38.401368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 647/1308] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:27:38.447009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c4e51-4f87-455b-b2e1-fb55d9059328 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:38.448037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c4e51-4f87-455b-b2e1-fb55d9059328 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:38.448427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c4e51-4f87-455b-b2e1-fb55d9059328 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:38.450231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 662/1309] 10.222.0.24 () {54 vars in 964 bytes} [Wed May 25 07:27:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:27:38.456847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d110ecc-64d1-4223-aed4-f29ca2af0a8f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:38.457141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d110ecc-64d1-4223-aed4-f29ca2af0a8f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:38.457517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d110ecc-64d1-4223-aed4-f29ca2af0a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:38.562962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5d110ecc-64d1-4223-aed4-f29ca2af0a8f None None] MFA Rules not processed for user `a5f94913ac8a463db617fbe30df395b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:27:38.564944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5d110ecc-64d1-4223-aed4-f29ca2af0a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:38.603454 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:38.649214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 648/1310] 10.222.0.24 () {58 vars in 1061 bytes} [Wed May 25 07:27:38 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:27:38.658532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c4e51-4f87-455b-b2e1-fb55d9059328 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:27:38.660606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8a6c4e51-4f87-455b-b2e1-fb55d9059328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:38.775001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c4e51-4f87-455b-b2e1-fb55d9059328 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:27:38.856236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb62656d-3727-4803-b111-dcd1b0bbb1e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:27:38.857302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62656d-3727-4803-b111-dcd1b0bbb1e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:38.857803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62656d-3727-4803-b111-dcd1b0bbb1e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:38.858293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb62656d-3727-4803-b111-dcd1b0bbb1e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:38.860134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cb62656d-3727-4803-b111-dcd1b0bbb1e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:38.917276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:38.976897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62656d-3727-4803-b111-dcd1b0bbb1e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:27:38.978870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb62656d-3727-4803-b111-dcd1b0bbb1e1 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:27:38.999682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 663/1311] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:27:41.602180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ba2f1-8d15-4f9a-84d8-f19cb236f1cd None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:41.602927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ba2f1-8d15-4f9a-84d8-f19cb236f1cd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:41.602927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ba2f1-8d15-4f9a-84d8-f19cb236f1cd None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:41.608918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 649/1312] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:27:41.610634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a6e59-3ff5-43d4-97fc-a7a5275b7ae5 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:41.611057 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a6e59-3ff5-43d4-97fc-a7a5275b7ae5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:41.611206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6a6e59-3ff5-43d4-97fc-a7a5275b7ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:41.686051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ed6a6e59-3ff5-43d4-97fc-a7a5275b7ae5 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:27:41.687340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ed6a6e59-3ff5-43d4-97fc-a7a5275b7ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:41.788403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 664/1313] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:27:41.827330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ba2f1-8d15-4f9a-84d8-f19cb236f1cd None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:27:41.828734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f98ba2f1-8d15-4f9a-84d8-f19cb236f1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:41.941728 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ba2f1-8d15-4f9a-84d8-f19cb236f1cd None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:27:42.027504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:42.029855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f884c3-bdc0-4aeb-9143-eebf1c95aa08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:27:42.030747 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f884c3-bdc0-4aeb-9143-eebf1c95aa08 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:42.031129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f884c3-bdc0-4aeb-9143-eebf1c95aa08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:42.031505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f884c3-bdc0-4aeb-9143-eebf1c95aa08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:42.033288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-48f884c3-bdc0-4aeb-9143-eebf1c95aa08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:42.157780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f884c3-bdc0-4aeb-9143-eebf1c95aa08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:27:42.159307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f884c3-bdc0-4aeb-9143-eebf1c95aa08 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:27:42.179559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 650/1314] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:27:44.975092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c75ac5-741d-48fc-bc6c-1ae04b1c9cc6 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:44.976000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c75ac5-741d-48fc-bc6c-1ae04b1c9cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:44.976000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c75ac5-741d-48fc-bc6c-1ae04b1c9cc6 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:44.977533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 665/1315] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:27:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:27:44.982680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e5fe-e37b-4b70-a3fd-5bb0317d3293 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:44.983105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e5fe-e37b-4b70-a3fd-5bb0317d3293 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:44.983207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d5e5fe-e37b-4b70-a3fd-5bb0317d3293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:45.045880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d9d5e5fe-e37b-4b70-a3fd-5bb0317d3293 None None] MFA Rules not processed for user `1ab4216474ef4cc89f2eee3dcc0873a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:27:45.047064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d9d5e5fe-e37b-4b70-a3fd-5bb0317d3293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:45.098235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:45.141643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 651/1316] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:27:44 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:27:45.195451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe352ecb-cfef-44fa-b9a8-8c01920a46cf None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:45.195736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe352ecb-cfef-44fa-b9a8-8c01920a46cf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:45.196013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe352ecb-cfef-44fa-b9a8-8c01920a46cf None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:45.197977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 666/1317] 10.222.0.24 () {54 vars in 964 bytes} [Wed May 25 07:27:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:27:45.203941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248a5f-18a6-4ae5-a0a4-b31f7babca15 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:45.204228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248a5f-18a6-4ae5-a0a4-b31f7babca15 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:45.204528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74248a5f-18a6-4ae5-a0a4-b31f7babca15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:45.277603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-74248a5f-18a6-4ae5-a0a4-b31f7babca15 None None] MFA Rules not processed for user `a5f94913ac8a463db617fbe30df395b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:27:45.278741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-74248a5f-18a6-4ae5-a0a4-b31f7babca15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:45.354105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 652/1318] 10.222.0.24 () {58 vars in 1061 bytes} [Wed May 25 07:27:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:27:45.363038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe352ecb-cfef-44fa-b9a8-8c01920a46cf None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:27:45.364563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fe352ecb-cfef-44fa-b9a8-8c01920a46cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:45.374223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:45.465836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe352ecb-cfef-44fa-b9a8-8c01920a46cf None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:27:45.536853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8974fa-9f1c-4d02-a4ad-7d29d0e6dbbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:27:45.537425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8974fa-9f1c-4d02-a4ad-7d29d0e6dbbb service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:45.537705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8974fa-9f1c-4d02-a4ad-7d29d0e6dbbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:45.537977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8974fa-9f1c-4d02-a4ad-7d29d0e6dbbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:45.539600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-da8974fa-9f1c-4d02-a4ad-7d29d0e6dbbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:45.601807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:45.648997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8974fa-9f1c-4d02-a4ad-7d29d0e6dbbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:27:45.650476 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8974fa-9f1c-4d02-a4ad-7d29d0e6dbbb service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:27:45.668561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 667/1319] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:27:45 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:27:49.084975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7bdb6-4ff7-4aec-8930-1d52ac1d7537 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:49.085517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7bdb6-4ff7-4aec-8930-1d52ac1d7537 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:49.085517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a7bdb6-4ff7-4aec-8930-1d52ac1d7537 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:49.086910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 653/1320] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:27:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:27:49.092719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237f36e-1df8-4f9b-8574-4528c4b26c70 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:49.093117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237f36e-1df8-4f9b-8574-4528c4b26c70 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:49.093270 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237f36e-1df8-4f9b-8574-4528c4b26c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:49.158425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a237f36e-1df8-4f9b-8574-4528c4b26c70 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:27:49.159624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a237f36e-1df8-4f9b-8574-4528c4b26c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:49.255356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 668/1321] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:27:49 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:27:49.300284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7bdb6-4ff7-4aec-8930-1d52ac1d7537 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:27:49.300284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a6a7bdb6-4ff7-4aec-8930-1d52ac1d7537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:49.346669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:49.399739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a7bdb6-4ff7-4aec-8930-1d52ac1d7537 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:27:49.473203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f186f38-f4d9-4e69-aaaa-48fb12997ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:27:49.473847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186f38-f4d9-4e69-aaaa-48fb12997ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:49.474128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186f38-f4d9-4e69-aaaa-48fb12997ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:49.474398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f186f38-f4d9-4e69-aaaa-48fb12997ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:49.476289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3f186f38-f4d9-4e69-aaaa-48fb12997ec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:49.571608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:49.585024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f186f38-f4d9-4e69-aaaa-48fb12997ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:27:49.586474 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f186f38-f4d9-4e69-aaaa-48fb12997ec8 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:27:49.607074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 654/1322] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:27:49 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:27:53.315293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068960d9-3eac-487d-9d88-f4d98f1178ca None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:53.315900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068960d9-3eac-487d-9d88-f4d98f1178ca None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:53.315900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068960d9-3eac-487d-9d88-f4d98f1178ca None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:53.317377 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 669/1323] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:27:53.322502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c175d0-0a18-4a89-8e49-be1f41222b08 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:53.322904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c175d0-0a18-4a89-8e49-be1f41222b08 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:53.323061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c175d0-0a18-4a89-8e49-be1f41222b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:53.388890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a7c175d0-0a18-4a89-8e49-be1f41222b08 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:27:53.390107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a7c175d0-0a18-4a89-8e49-be1f41222b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:53.488733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 655/1324] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:27:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:27:53.526944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068960d9-3eac-487d-9d88-f4d98f1178ca None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:27:53.528534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-068960d9-3eac-487d-9d88-f4d98f1178ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:53.548334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:53.635106 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068960d9-3eac-487d-9d88-f4d98f1178ca None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:27:53.706937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e269b0ad-32a2-4121-b2b2-48f692f54857 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:27:53.707576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269b0ad-32a2-4121-b2b2-48f692f54857 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:53.707852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269b0ad-32a2-4121-b2b2-48f692f54857 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:53.708121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e269b0ad-32a2-4121-b2b2-48f692f54857 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:53.709759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e269b0ad-32a2-4121-b2b2-48f692f54857 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:53.779727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:53.816789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269b0ad-32a2-4121-b2b2-48f692f54857 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:27:53.818226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e269b0ad-32a2-4121-b2b2-48f692f54857 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:27:53.836676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 670/1325] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:27:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:27:56.104073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212fd25-7455-4d6f-bf73-dcdae33411c3 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:56.104570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212fd25-7455-4d6f-bf73-dcdae33411c3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:56.104655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c212fd25-7455-4d6f-bf73-dcdae33411c3 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:56.106017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 656/1326] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:27:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:27:56.111163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72d9c-fd9c-47fe-b9d0-5e5b4e8afd87 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:56.111603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72d9c-fd9c-47fe-b9d0-5e5b4e8afd87 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:56.111720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff72d9c-fd9c-47fe-b9d0-5e5b4e8afd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:56.176180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-aff72d9c-fd9c-47fe-b9d0-5e5b4e8afd87 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:27:56.177491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-aff72d9c-fd9c-47fe-b9d0-5e5b4e8afd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:56.279203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 671/1327] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:27:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:27:56.315586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212fd25-7455-4d6f-bf73-dcdae33411c3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:27:56.317216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c212fd25-7455-4d6f-bf73-dcdae33411c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:56.380170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:56.423915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c212fd25-7455-4d6f-bf73-dcdae33411c3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:27:56.498083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f74125-6632-4e04-9b93-ca0d0e5e5b49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:27:56.498732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74125-6632-4e04-9b93-ca0d0e5e5b49 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:56.499013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74125-6632-4e04-9b93-ca0d0e5e5b49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:56.499424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f74125-6632-4e04-9b93-ca0d0e5e5b49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:56.501008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f7f74125-6632-4e04-9b93-ca0d0e5e5b49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:56.612520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:56.615315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f74125-6632-4e04-9b93-ca0d0e5e5b49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:27:56.616827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f74125-6632-4e04-9b93-ca0d0e5e5b49 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:27:56.636433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 657/1328] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:27:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:27:58.882270 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c3de3-a376-498e-912f-2c060cfe3142 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:58.882791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c3de3-a376-498e-912f-2c060cfe3142 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:58.882791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c3de3-a376-498e-912f-2c060cfe3142 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:58.884623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 672/1329] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:27:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:27:58.890089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73298535-cbe8-4d09-b693-bf0a79033eba None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:58.890526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73298535-cbe8-4d09-b693-bf0a79033eba None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:58.890765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73298535-cbe8-4d09-b693-bf0a79033eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:58.954591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-73298535-cbe8-4d09-b693-bf0a79033eba None None] MFA Rules not processed for user `1ab4216474ef4cc89f2eee3dcc0873a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:27:58.955769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-73298535-cbe8-4d09-b693-bf0a79033eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:59.050579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 658/1330] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:27:58 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:27:59.087857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c3de3-a376-498e-912f-2c060cfe3142 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:27:59.089563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d97c3de3-a376-498e-912f-2c060cfe3142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:59.120832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:59.192287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c3de3-a376-498e-912f-2c060cfe3142 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:27:59.264800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45368df-5347-4e9f-93c7-c0597147bd4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:27:59.265441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45368df-5347-4e9f-93c7-c0597147bd4c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:27:59.265722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45368df-5347-4e9f-93c7-c0597147bd4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:27:59.265994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45368df-5347-4e9f-93c7-c0597147bd4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:27:59.267612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d45368df-5347-4e9f-93c7-c0597147bd4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:27:59.343764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:27:59.376574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45368df-5347-4e9f-93c7-c0597147bd4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:27:59.378130 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45368df-5347-4e9f-93c7-c0597147bd4c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:27:59.398040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 673/1331] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:27:59 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:01.991862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6302de-de60-47a1-b841-5502d9be0c03 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:01.992391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6302de-de60-47a1-b841-5502d9be0c03 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:01.992510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6302de-de60-47a1-b841-5502d9be0c03 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:01.994459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 659/1332] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:01.999763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5fec5-a7fe-4a92-bf9c-53e1fced8a41 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:02.000181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5fec5-a7fe-4a92-bf9c-53e1fced8a41 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:02.000317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d5fec5-a7fe-4a92-bf9c-53e1fced8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:02.098859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-65d5fec5-a7fe-4a92-bf9c-53e1fced8a41 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:02.099953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-65d5fec5-a7fe-4a92-bf9c-53e1fced8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:02.208203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 674/1333] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:02.245051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6302de-de60-47a1-b841-5502d9be0c03 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:02.246576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8e6302de-de60-47a1-b841-5502d9be0c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:02.324821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:02.367475 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6302de-de60-47a1-b841-5502d9be0c03 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:02.447783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b1cf4-054f-4245-a837-33ccc5c1640d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:02.448388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1cf4-054f-4245-a837-33ccc5c1640d service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:02.448782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1cf4-054f-4245-a837-33ccc5c1640d service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:02.449792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b1cf4-054f-4245-a837-33ccc5c1640d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:02.451476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-977b1cf4-054f-4245-a837-33ccc5c1640d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:02.565553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b1cf4-054f-4245-a837-33ccc5c1640d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:02.567133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b1cf4-054f-4245-a837-33ccc5c1640d service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:02.580963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:02.590040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 660/1334] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:04.839651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c25ce-0bc2-46ca-bf5d-f15412937056 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:04.840182 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c25ce-0bc2-46ca-bf5d-f15412937056 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:04.840182 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c25ce-0bc2-46ca-bf5d-f15412937056 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:04.841609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 675/1335] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:04.846790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff22076-a98a-4b52-b292-f2d516927834 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:04.847166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff22076-a98a-4b52-b292-f2d516927834 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:04.847351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff22076-a98a-4b52-b292-f2d516927834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:04.911193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1ff22076-a98a-4b52-b292-f2d516927834 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:04.912391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1ff22076-a98a-4b52-b292-f2d516927834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:05.006277 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 661/1336] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:05.046135 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c25ce-0bc2-46ca-bf5d-f15412937056 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:05.047651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-108c25ce-0bc2-46ca-bf5d-f15412937056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:05.087851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:05.152615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c25ce-0bc2-46ca-bf5d-f15412937056 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:05.227165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90775633-d82c-4abc-af3f-db5592eae6ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:05.228543 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775633-d82c-4abc-af3f-db5592eae6ac service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:05.228830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775633-d82c-4abc-af3f-db5592eae6ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:05.229107 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90775633-d82c-4abc-af3f-db5592eae6ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:05.230810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-90775633-d82c-4abc-af3f-db5592eae6ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:05.312490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:05.337605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90775633-d82c-4abc-af3f-db5592eae6ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:05.339254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90775633-d82c-4abc-af3f-db5592eae6ac service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:05.358062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 676/1337] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:08.306845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf29c57-468a-4e55-9403-ba2c55f75d45 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:08.307430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf29c57-468a-4e55-9403-ba2c55f75d45 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:08.307430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf29c57-468a-4e55-9403-ba2c55f75d45 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:08.308807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 662/1338] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:08.314357 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad2ee-35aa-45d2-a059-39beb961d1f2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:08.314766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad2ee-35aa-45d2-a059-39beb961d1f2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:08.314912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790ad2ee-35aa-45d2-a059-39beb961d1f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:08.381118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-790ad2ee-35aa-45d2-a059-39beb961d1f2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:08.382229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-790ad2ee-35aa-45d2-a059-39beb961d1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:08.478144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 677/1339] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:08 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:08.513978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf29c57-468a-4e55-9403-ba2c55f75d45 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:08.517347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bdf29c57-468a-4e55-9403-ba2c55f75d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:08.599396 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:08.631598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf29c57-468a-4e55-9403-ba2c55f75d45 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:08.635776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aca6a9-a667-471e-b978-1b500ccfa641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:08.640093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca6a9-a667-471e-b978-1b500ccfa641 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:08.640093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca6a9-a667-471e-b978-1b500ccfa641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:08.640093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aca6a9-a667-471e-b978-1b500ccfa641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:08.640093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-20aca6a9-a667-471e-b978-1b500ccfa641 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:08.741915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca6a9-a667-471e-b978-1b500ccfa641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:08.743426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aca6a9-a667-471e-b978-1b500ccfa641 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:08.765075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 663/1340] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:13.335691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e109996-8138-4239-b86d-75913a826b06 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:13.338340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e109996-8138-4239-b86d-75913a826b06 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:13.338340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e109996-8138-4239-b86d-75913a826b06 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:13.339189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 678/1341] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:13.343840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f36cb7-3b4e-44ad-83f1-a6a01e6319f3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:13.344286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f36cb7-3b4e-44ad-83f1-a6a01e6319f3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:13.344425 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f36cb7-3b4e-44ad-83f1-a6a01e6319f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:13.393298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c7f36cb7-3b4e-44ad-83f1-a6a01e6319f3 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:13.394506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c7f36cb7-3b4e-44ad-83f1-a6a01e6319f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:13.453787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:13.474288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 664/1342] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:13.513567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e109996-8138-4239-b86d-75913a826b06 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:13.525366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e109996-8138-4239-b86d-75913a826b06 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:13.528894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb69fa-f02c-4852-9776-0f6fde888ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:13.529530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb69fa-f02c-4852-9776-0f6fde888ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:13.529809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb69fa-f02c-4852-9776-0f6fde888ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:13.530080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb69fa-f02c-4852-9776-0f6fde888ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:13.538903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb69fa-f02c-4852-9776-0f6fde888ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:13.540373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb69fa-f02c-4852-9776-0f6fde888ee9 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:13.549645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 679/1343] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:16.753980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a340d7-3c5d-4796-9be1-00d4ba725f42 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:16.754567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a340d7-3c5d-4796-9be1-00d4ba725f42 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:16.754567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a340d7-3c5d-4796-9be1-00d4ba725f42 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:16.756060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 665/1344] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:16.761866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc277f4-1aa0-4630-9ebe-3b669c6b1fa2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:16.762328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc277f4-1aa0-4630-9ebe-3b669c6b1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:16.762428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc277f4-1aa0-4630-9ebe-3b669c6b1fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:16.789521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6bc277f4-1aa0-4630-9ebe-3b669c6b1fa2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:16.791363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6bc277f4-1aa0-4630-9ebe-3b669c6b1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:16.799091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 680/1345] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:16 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:16.836032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a340d7-3c5d-4796-9be1-00d4ba725f42 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:16.847686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a340d7-3c5d-4796-9be1-00d4ba725f42 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:16.851393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c49d29-99b3-4335-9f70-0504566ad698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:16.852025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49d29-99b3-4335-9f70-0504566ad698 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:16.852382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49d29-99b3-4335-9f70-0504566ad698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:16.852775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c49d29-99b3-4335-9f70-0504566ad698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:16.861819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49d29-99b3-4335-9f70-0504566ad698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:16.863238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c49d29-99b3-4335-9f70-0504566ad698 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:16.872668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 666/1346] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:21.258130 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cab88-b035-4cf4-b6c4-658ae3034fb7 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:21.259173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cab88-b035-4cf4-b6c4-658ae3034fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:21.259173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8cab88-b035-4cf4-b6c4-658ae3034fb7 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:21.260869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 681/1347] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:21.266262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063738-4a86-40ce-bc4c-28477ea07ee3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:21.266691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063738-4a86-40ce-bc4c-28477ea07ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:21.266833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee063738-4a86-40ce-bc4c-28477ea07ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:21.293723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ee063738-4a86-40ce-bc4c-28477ea07ee3 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:21.293723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ee063738-4a86-40ce-bc4c-28477ea07ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:21.294251 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 667/1348] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:21.331578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cab88-b035-4cf4-b6c4-658ae3034fb7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:21.342793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8cab88-b035-4cf4-b6c4-658ae3034fb7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:21.346289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868e41fb-1511-47f1-895c-75db5eeeeb37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:21.346922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e41fb-1511-47f1-895c-75db5eeeeb37 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:21.347202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e41fb-1511-47f1-895c-75db5eeeeb37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:21.347482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868e41fb-1511-47f1-895c-75db5eeeeb37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:21.356934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e41fb-1511-47f1-895c-75db5eeeeb37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:21.358380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868e41fb-1511-47f1-895c-75db5eeeeb37 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:21.368117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 682/1349] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:26.915536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc23a6-9084-4221-94f9-8f3c88f3ef0f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:26.916432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc23a6-9084-4221-94f9-8f3c88f3ef0f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:26.916976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccc23a6-9084-4221-94f9-8f3c88f3ef0f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:26.919002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 668/1350] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:28:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:26.924256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a07c0-ff7b-4ca9-8313-2897a2399e5e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:26.925170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a07c0-ff7b-4ca9-8313-2897a2399e5e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:26.925697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a07c0-ff7b-4ca9-8313-2897a2399e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:26.929674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:27.003979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d07a07c0-ff7b-4ca9-8313-2897a2399e5e None None] MFA Rules not processed for user `762b38d08d2447bfbc968245a5b2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:27.005550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d07a07c0-ff7b-4ca9-8313-2897a2399e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:27.090795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 683/1351] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:28:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:28:31.228320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c09da-9d8b-4e58-a500-53d4d972de1a None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:31.228320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c09da-9d8b-4e58-a500-53d4d972de1a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:31.228320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c09da-9d8b-4e58-a500-53d4d972de1a None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:31.228320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 669/1352] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:31.233918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcd15-6b31-4deb-a7fe-8bf8be32c9f2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:31.234382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcd15-6b31-4deb-a7fe-8bf8be32c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:31.234466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4fcd15-6b31-4deb-a7fe-8bf8be32c9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:31.253279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9f4fcd15-6b31-4deb-a7fe-8bf8be32c9f2 None None] MFA Rules not processed for user `762b38d08d2447bfbc968245a5b2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:31.254766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9f4fcd15-6b31-4deb-a7fe-8bf8be32c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:31.264019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 684/1353] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:28:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:31.279919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=15 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:32.911343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e976d-43c7-4add-8878-849b747d4f04 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:32.911985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e976d-43c7-4add-8878-849b747d4f04 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:32.911985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e976d-43c7-4add-8878-849b747d4f04 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:32.913218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 670/1354] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:28:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:32.918890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ed0c-acc6-4f4c-be35-29fe8aebce21 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:32.919365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ed0c-acc6-4f4c-be35-29fe8aebce21 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:32.919567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ed0c-acc6-4f4c-be35-29fe8aebce21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:32.937877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0163ed0c-acc6-4f4c-be35-29fe8aebce21 None None] MFA Rules not processed for user `762b38d08d2447bfbc968245a5b2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:32.939151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0163ed0c-acc6-4f4c-be35-29fe8aebce21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:32.947899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 685/1355] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:28:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:28:36.894115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c411a-e606-404b-8e7c-1cf3129b4de3 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:36.894626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c411a-e606-404b-8e7c-1cf3129b4de3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:36.894849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c411a-e606-404b-8e7c-1cf3129b4de3 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:36.896564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 671/1356] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:36.902762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3a88-266b-4864-8b2f-77259a34e677 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:36.903228 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3a88-266b-4864-8b2f-77259a34e677 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:36.903563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658b3a88-266b-4864-8b2f-77259a34e677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:36.921975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-658b3a88-266b-4864-8b2f-77259a34e677 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:36.923462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-658b3a88-266b-4864-8b2f-77259a34e677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:36.931965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 686/1357] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:36.989078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f8b2-bca3-4f3d-b98c-06789ca0ecfd None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:36.989372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f8b2-bca3-4f3d-b98c-06789ca0ecfd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:36.989651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49f8b2-bca3-4f3d-b98c-06789ca0ecfd None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:36.991064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 672/1358] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 07:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:36.999573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b79f0-5785-4806-aba0-1f8a85a8c41c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:37.000262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b79f0-5785-4806-aba0-1f8a85a8c41c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:37.000778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b79f0-5785-4806-aba0-1f8a85a8c41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:37.056092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-494b79f0-5785-4806-aba0-1f8a85a8c41c None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:37.057506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-494b79f0-5785-4806-aba0-1f8a85a8c41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:37.121478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:37.152067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 687/1359] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 07:28:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:37.159828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f8b2-bca3-4f3d-b98c-06789ca0ecfd None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:37.175469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49f8b2-bca3-4f3d-b98c-06789ca0ecfd None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:37.181341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3d933-b1a6-46d8-9748-4cac97a6c3b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:37.182118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d933-b1a6-46d8-9748-4cac97a6c3b5 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:37.182504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d933-b1a6-46d8-9748-4cac97a6c3b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:37.182968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3d933-b1a6-46d8-9748-4cac97a6c3b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:37.191886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3d933-b1a6-46d8-9748-4cac97a6c3b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:37.193654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3d933-b1a6-46d8-9748-4cac97a6c3b5 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:37.204938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 673/1360] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:39.700695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ed39d-01e9-4886-bc75-1a85f34a50cf None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:39.701234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ed39d-01e9-4886-bc75-1a85f34a50cf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:39.701504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ed39d-01e9-4886-bc75-1a85f34a50cf None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:39.703161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 688/1361] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:39.708557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3e84e-4149-4418-8d87-132b4c940e1f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:39.709359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3e84e-4149-4418-8d87-132b4c940e1f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:39.709890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3e84e-4149-4418-8d87-132b4c940e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:39.731437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-86b3e84e-4149-4418-8d87-132b4c940e1f None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:39.733380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-86b3e84e-4149-4418-8d87-132b4c940e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:39.743719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 674/1362] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:39.787176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ed39d-01e9-4886-bc75-1a85f34a50cf None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:39.802536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ed39d-01e9-4886-bc75-1a85f34a50cf None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:39.808623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794b84-3e53-4c39-a3a5-c10ce3a65e32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:39.809270 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794b84-3e53-4c39-a3a5-c10ce3a65e32 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:39.809555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794b84-3e53-4c39-a3a5-c10ce3a65e32 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:39.809836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794b84-3e53-4c39-a3a5-c10ce3a65e32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:39.819156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf794b84-3e53-4c39-a3a5-c10ce3a65e32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:39.820972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf794b84-3e53-4c39-a3a5-c10ce3a65e32 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:39.831672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 689/1363] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:42.541657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc6dc-677a-4143-9dee-b4b6b9f83bac None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:42.542543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc6dc-677a-4143-9dee-b4b6b9f83bac None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:42.542976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc6dc-677a-4143-9dee-b4b6b9f83bac None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:42.544814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 675/1364] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:42.550696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21f73-fe67-4376-856a-1f5a78e62b83 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:42.551484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21f73-fe67-4376-856a-1f5a78e62b83 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:42.551932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a21f73-fe67-4376-856a-1f5a78e62b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:42.572954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-96a21f73-fe67-4376-856a-1f5a78e62b83 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:42.574073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-96a21f73-fe67-4376-856a-1f5a78e62b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:42.584318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 690/1365] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:42.630943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818a27-13c0-48d9-ac01-4093d71c0789 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:42.631229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818a27-13c0-48d9-ac01-4093d71c0789 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:42.631509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b818a27-13c0-48d9-ac01-4093d71c0789 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:42.632974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 676/1366] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 07:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:42.638607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece23b9-a4d0-4c26-99c4-f904e3284701 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:42.638894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece23b9-a4d0-4c26-99c4-f904e3284701 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:42.639196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece23b9-a4d0-4c26-99c4-f904e3284701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:42.659977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cece23b9-a4d0-4c26-99c4-f904e3284701 None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:42.661191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cece23b9-a4d0-4c26-99c4-f904e3284701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:42.671236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 691/1367] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 07:28:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:42.679149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b818a27-13c0-48d9-ac01-4093d71c0789 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:42.693626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b818a27-13c0-48d9-ac01-4093d71c0789 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:42.699720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f8aac2-3930-47d6-91ce-948560aa206c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:42.700701 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8aac2-3930-47d6-91ce-948560aa206c service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:42.701233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8aac2-3930-47d6-91ce-948560aa206c service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:42.701692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f8aac2-3930-47d6-91ce-948560aa206c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:42.710602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8aac2-3930-47d6-91ce-948560aa206c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:42.712829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f8aac2-3930-47d6-91ce-948560aa206c service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:42.723118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 677/1368] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:28:45.141574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102193fb-cdee-4fb8-b74e-a6b174496566 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:45.142106 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102193fb-cdee-4fb8-b74e-a6b174496566 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:45.142106 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102193fb-cdee-4fb8-b74e-a6b174496566 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:45.143491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 692/1369] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:28:45.149469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e50c9b-deae-4ed0-bbd5-a778b7830e46 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:45.150046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e50c9b-deae-4ed0-bbd5-a778b7830e46 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:45.150046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e50c9b-deae-4ed0-bbd5-a778b7830e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:45.167800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c7e50c9b-deae-4ed0-bbd5-a778b7830e46 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:45.169028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c7e50c9b-deae-4ed0-bbd5-a778b7830e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:45.177130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 678/1370] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:45.221646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102193fb-cdee-4fb8-b74e-a6b174496566 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:45.237173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102193fb-cdee-4fb8-b74e-a6b174496566 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:45.246766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8199fca8-7467-4ee0-8951-0a2cb9a68a3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:45.247624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199fca8-7467-4ee0-8951-0a2cb9a68a3e service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:45.247912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199fca8-7467-4ee0-8951-0a2cb9a68a3e service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:45.248196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8199fca8-7467-4ee0-8951-0a2cb9a68a3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:45.257985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199fca8-7467-4ee0-8951-0a2cb9a68a3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:45.259923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8199fca8-7467-4ee0-8951-0a2cb9a68a3e service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:45.271039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 693/1371] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:45.299509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326daf3-650f-4928-82f7-cbec39084e97 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:45.299800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326daf3-650f-4928-82f7-cbec39084e97 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:45.300131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b326daf3-650f-4928-82f7-cbec39084e97 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:45.301608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 679/1372] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:45.308521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7594d-8288-44b6-ac2e-f3a5c9b68f43 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:45.309097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7594d-8288-44b6-ac2e-f3a5c9b68f43 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:45.309377 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7594d-8288-44b6-ac2e-f3a5c9b68f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:45.328149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6ca7594d-8288-44b6-ac2e-f3a5c9b68f43 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:45.329387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6ca7594d-8288-44b6-ac2e-f3a5c9b68f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:45.337380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 694/1373] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:45.646456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd82b6f-b6ac-4712-b313-f71068782c8c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:45.646456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd82b6f-b6ac-4712-b313-f71068782c8c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:45.646456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd82b6f-b6ac-4712-b313-f71068782c8c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:45.647999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 680/1374] 10.222.0.24 () {54 vars in 963 bytes} [Wed May 25 07:28:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:45.655046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e355f-af2e-413d-bc79-a3a898d5e1d8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:45.655350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e355f-af2e-413d-bc79-a3a898d5e1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:45.655767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e355f-af2e-413d-bc79-a3a898d5e1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:45.707273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ff4e355f-af2e-413d-bc79-a3a898d5e1d8 None None] MFA Rules not processed for user `e08e18aa7d0941f9892986e737ba9e98`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:45.708459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ff4e355f-af2e-413d-bc79-a3a898d5e1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:45.771940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 695/1375] 10.222.0.24 () {58 vars in 1060 bytes} [Wed May 25 07:28:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:45.779709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd82b6f-b6ac-4712-b313-f71068782c8c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:45.790957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd82b6f-b6ac-4712-b313-f71068782c8c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:45.794421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e82a08e-3c3d-420f-8d74-834df4c73939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:45.795068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82a08e-3c3d-420f-8d74-834df4c73939 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:45.795347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82a08e-3c3d-420f-8d74-834df4c73939 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:45.795620 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e82a08e-3c3d-420f-8d74-834df4c73939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:45.805206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82a08e-3c3d-420f-8d74-834df4c73939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:45.806746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e82a08e-3c3d-420f-8d74-834df4c73939 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:45.816875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 681/1376] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:28:47.717027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a867e-2e42-4899-8ac3-ef58cda19e3f None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:47.717676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a867e-2e42-4899-8ac3-ef58cda19e3f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:47.717676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a867e-2e42-4899-8ac3-ef58cda19e3f None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:47.719004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 696/1377] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:47.725004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa04677-fb1a-41ce-9031-6fda697b1e9d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:47.725574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa04677-fb1a-41ce-9031-6fda697b1e9d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:47.725574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa04677-fb1a-41ce-9031-6fda697b1e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:47.746107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8fa04677-fb1a-41ce-9031-6fda697b1e9d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:47.747333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8fa04677-fb1a-41ce-9031-6fda697b1e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:47.755420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 682/1378] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:47.802751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a867e-2e42-4899-8ac3-ef58cda19e3f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:47.818301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a867e-2e42-4899-8ac3-ef58cda19e3f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:47.825019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada0dbd1-b26a-43dc-8108-c0ce913511a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:47.825696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0dbd1-b26a-43dc-8108-c0ce913511a6 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:47.825983 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0dbd1-b26a-43dc-8108-c0ce913511a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:47.826261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada0dbd1-b26a-43dc-8108-c0ce913511a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:47.835408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0dbd1-b26a-43dc-8108-c0ce913511a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:47.837483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada0dbd1-b26a-43dc-8108-c0ce913511a6 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:47.848208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 697/1379] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:50.229236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473857af-8ba4-4874-8b42-8d3c5ff0282b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:50.230133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473857af-8ba4-4874-8b42-8d3c5ff0282b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:50.230416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473857af-8ba4-4874-8b42-8d3c5ff0282b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:50.231796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 683/1380] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:50.237306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714e8d8-1bb8-4c4f-9830-6d0941c82128 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:50.237732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714e8d8-1bb8-4c4f-9830-6d0941c82128 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:50.237860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9714e8d8-1bb8-4c4f-9830-6d0941c82128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:50.256197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9714e8d8-1bb8-4c4f-9830-6d0941c82128 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:50.257414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9714e8d8-1bb8-4c4f-9830-6d0941c82128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:50.265909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 698/1381] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:50.310461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473857af-8ba4-4874-8b42-8d3c5ff0282b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:50.328198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473857af-8ba4-4874-8b42-8d3c5ff0282b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:50.334395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da433d-56ce-41c9-b40d-be7cb774ebf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:50.335048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da433d-56ce-41c9-b40d-be7cb774ebf7 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:50.335333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da433d-56ce-41c9-b40d-be7cb774ebf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:50.335707 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da433d-56ce-41c9-b40d-be7cb774ebf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:50.345180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da433d-56ce-41c9-b40d-be7cb774ebf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:50.346752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da433d-56ce-41c9-b40d-be7cb774ebf7 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:50.357437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 684/1382] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:28:52.729366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03922fb7-079f-4151-9371-63c7a588d0e3 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:52.729953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03922fb7-079f-4151-9371-63c7a588d0e3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:52.729953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03922fb7-079f-4151-9371-63c7a588d0e3 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:52.732350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 699/1383] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:52.737568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb903414-1173-4c2a-9814-b4239636e0e6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:52.738084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb903414-1173-4c2a-9814-b4239636e0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:52.738162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb903414-1173-4c2a-9814-b4239636e0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:52.758150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-bb903414-1173-4c2a-9814-b4239636e0e6 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:52.759451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bb903414-1173-4c2a-9814-b4239636e0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:52.767612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 685/1384] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:52.812102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03922fb7-079f-4151-9371-63c7a588d0e3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:52.827469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03922fb7-079f-4151-9371-63c7a588d0e3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:52.833172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b884f1-6261-47ff-813d-931d1a12fec0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:52.833925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b884f1-6261-47ff-813d-931d1a12fec0 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:52.834297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b884f1-6261-47ff-813d-931d1a12fec0 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:52.834665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b884f1-6261-47ff-813d-931d1a12fec0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:52.844513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b884f1-6261-47ff-813d-931d1a12fec0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:52.846197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b884f1-6261-47ff-813d-931d1a12fec0 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:52.857183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 700/1385] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:28:55.317945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de300d0-87e2-4001-a88a-cb8bdb85dbed None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:55.318528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de300d0-87e2-4001-a88a-cb8bdb85dbed None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:55.318740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de300d0-87e2-4001-a88a-cb8bdb85dbed None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:55.320735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 686/1386] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:55.326335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976dfe6-e612-44d8-9d4a-e246d16a38c3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:55.326898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976dfe6-e612-44d8-9d4a-e246d16a38c3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:55.326898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4976dfe6-e612-44d8-9d4a-e246d16a38c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:55.345706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4976dfe6-e612-44d8-9d4a-e246d16a38c3 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:55.346938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4976dfe6-e612-44d8-9d4a-e246d16a38c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:55.355914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 701/1387] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:55.403078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de300d0-87e2-4001-a88a-cb8bdb85dbed None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:55.418842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de300d0-87e2-4001-a88a-cb8bdb85dbed None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:55.424530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4028953-7be4-46c2-a6eb-81dd8b34e3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:55.425194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4028953-7be4-46c2-a6eb-81dd8b34e3a6 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:55.425484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4028953-7be4-46c2-a6eb-81dd8b34e3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:55.425768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4028953-7be4-46c2-a6eb-81dd8b34e3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:55.435258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4028953-7be4-46c2-a6eb-81dd8b34e3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:55.436944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4028953-7be4-46c2-a6eb-81dd8b34e3a6 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:55.446892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 687/1388] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:28:57.800137 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dbd86-599e-4ea1-b40c-c1a573cf4f82 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:57.800728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dbd86-599e-4ea1-b40c-c1a573cf4f82 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:57.800896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8dbd86-599e-4ea1-b40c-c1a573cf4f82 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:57.802697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 702/1389] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:28:57.807882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dd32b-f7bd-4f72-a13a-7010615eb5ab None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:57.808456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dd32b-f7bd-4f72-a13a-7010615eb5ab None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:57.808456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3dd32b-f7bd-4f72-a13a-7010615eb5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:57.826558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7a3dd32b-f7bd-4f72-a13a-7010615eb5ab None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:28:57.827735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7a3dd32b-f7bd-4f72-a13a-7010615eb5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:28:57.836315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 688/1390] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:28:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:28:57.883493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dbd86-599e-4ea1-b40c-c1a573cf4f82 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:28:57.902229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8dbd86-599e-4ea1-b40c-c1a573cf4f82 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:28:57.908980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51657c54-c038-42db-be9a-561a6a8d6e7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:28:57.909780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657c54-c038-42db-be9a-561a6a8d6e7e service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:28:57.910144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657c54-c038-42db-be9a-561a6a8d6e7e service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:28:57.910700 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51657c54-c038-42db-be9a-561a6a8d6e7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:28:57.921948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51657c54-c038-42db-be9a-561a6a8d6e7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:28:57.923975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51657c54-c038-42db-be9a-561a6a8d6e7e service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:28:57.935932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 703/1391] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:28:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:00.312540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64d15-df49-4fef-bcbb-8f7c4db3c6c3 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:00.313102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64d15-df49-4fef-bcbb-8f7c4db3c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:00.313102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d64d15-df49-4fef-bcbb-8f7c4db3c6c3 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:00.314656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 689/1392] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:29:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:00.320095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e1e2c-efbc-46fe-85f8-63a97f0f2460 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:00.320640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e1e2c-efbc-46fe-85f8-63a97f0f2460 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:00.320748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e1e2c-efbc-46fe-85f8-63a97f0f2460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:00.338318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-651e1e2c-efbc-46fe-85f8-63a97f0f2460 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:00.339507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-651e1e2c-efbc-46fe-85f8-63a97f0f2460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:00.347560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 704/1393] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:00.392922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64d15-df49-4fef-bcbb-8f7c4db3c6c3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:00.407631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d64d15-df49-4fef-bcbb-8f7c4db3c6c3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:00.413011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765ff02-309a-49f0-9a4f-e0d9a94edd46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:00.414156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765ff02-309a-49f0-9a4f-e0d9a94edd46 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:00.414435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765ff02-309a-49f0-9a4f-e0d9a94edd46 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:00.414709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765ff02-309a-49f0-9a4f-e0d9a94edd46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:00.423220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765ff02-309a-49f0-9a4f-e0d9a94edd46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:00.429864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765ff02-309a-49f0-9a4f-e0d9a94edd46 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:00.435449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 690/1394] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:01.972261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d3e6-2c16-41e3-a410-6c3a105d0a89 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:01.972847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d3e6-2c16-41e3-a410-6c3a105d0a89 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:01.972847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6d3e6-2c16-41e3-a410-6c3a105d0a89 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:01.974551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 705/1395] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:01.980231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c16ae4-40a4-4aa1-b9df-fc35b7320851 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:01.980706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c16ae4-40a4-4aa1-b9df-fc35b7320851 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:01.980813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c16ae4-40a4-4aa1-b9df-fc35b7320851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:01.986765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=52 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:29:01.999297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-09c16ae4-40a4-4aa1-b9df-fc35b7320851 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:02.006438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-09c16ae4-40a4-4aa1-b9df-fc35b7320851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:02.009434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 691/1396] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:29:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:02.066493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca9ad-0f4f-48a5-9e14-14e15245ddb7 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:02.066778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca9ad-0f4f-48a5-9e14-14e15245ddb7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:02.067051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ca9ad-0f4f-48a5-9e14-14e15245ddb7 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:02.068462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 706/1397] 10.222.0.24 () {54 vars in 962 bytes} [Wed May 25 07:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:02.074324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022cb24-7451-4476-bfbc-addc0ba281d4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:02.074615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022cb24-7451-4476-bfbc-addc0ba281d4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:02.074942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022cb24-7451-4476-bfbc-addc0ba281d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:02.124374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e022cb24-7451-4476-bfbc-addc0ba281d4 None None] MFA Rules not processed for user `451754f5553e4b9783b4e75f6d408ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:02.125607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e022cb24-7451-4476-bfbc-addc0ba281d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:02.189712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 692/1398] 10.222.0.24 () {58 vars in 1059 bytes} [Wed May 25 07:29:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:02.198215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ca9ad-0f4f-48a5-9e14-14e15245ddb7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:02.209040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ca9ad-0f4f-48a5-9e14-14e15245ddb7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:02.213445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff3bbf3-2062-4a4d-9616-58ffb1349c61 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451754f5553e4b9783b4e75f6d408ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:02.214162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3bbf3-2062-4a4d-9616-58ffb1349c61 service glance] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:02.214518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3bbf3-2062-4a4d-9616-58ffb1349c61 service glance] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:02.214863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3bbf3-2062-4a4d-9616-58ffb1349c61 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:02.223969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3bbf3-2062-4a4d-9616-58ffb1349c61 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:02.225482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff3bbf3-2062-4a4d-9616-58ffb1349c61 service glance] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:02.230385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:29:02.236374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 707/1399] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:02.735276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512a1c3-fe05-44db-a94f-0c471eea87d8 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:02.735617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512a1c3-fe05-44db-a94f-0c471eea87d8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:02.735903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512a1c3-fe05-44db-a94f-0c471eea87d8 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:02.737588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 693/1400] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:29:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:02.743552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fdfcc-8bac-4996-90f0-69c7e0b0088f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:02.746728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fdfcc-8bac-4996-90f0-69c7e0b0088f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:02.746728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fdfcc-8bac-4996-90f0-69c7e0b0088f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:02.763054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e39fdfcc-8bac-4996-90f0-69c7e0b0088f None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:02.764276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e39fdfcc-8bac-4996-90f0-69c7e0b0088f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:02.774337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 708/1401] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:29:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:02.820250 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512a1c3-fe05-44db-a94f-0c471eea87d8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:02.833916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512a1c3-fe05-44db-a94f-0c471eea87d8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:02.839868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcfc072-0097-47d1-acac-2aa8d82b8aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:02.840538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfc072-0097-47d1-acac-2aa8d82b8aff service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:02.840828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfc072-0097-47d1-acac-2aa8d82b8aff service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:02.841106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcfc072-0097-47d1-acac-2aa8d82b8aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:02.849175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfc072-0097-47d1-acac-2aa8d82b8aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:02.854004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcfc072-0097-47d1-acac-2aa8d82b8aff service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:02.861380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 694/1402] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:02.963482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92936ae8-d960-4134-ad46-089a4545a954 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:02.963768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92936ae8-d960-4134-ad46-089a4545a954 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:02.964046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92936ae8-d960-4134-ad46-089a4545a954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:03.013436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-92936ae8-d960-4134-ad46-089a4545a954 None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:03.014635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-92936ae8-d960-4134-ad46-089a4545a954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:03.077597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 709/1403] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:29:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:03.124745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e995b7-8cc4-4f20-8e06-2e6fc8921622 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:03.125330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e995b7-8cc4-4f20-8e06-2e6fc8921622 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:03.125330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e995b7-8cc4-4f20-8e06-2e6fc8921622 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:03.126909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 695/1404] 10.222.0.24 () {54 vars in 942 bytes} [Wed May 25 07:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:03.134448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f03ebd-20c0-49ad-90fc-52f59086da12 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:03.134740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f03ebd-20c0-49ad-90fc-52f59086da12 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:03.135019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f03ebd-20c0-49ad-90fc-52f59086da12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:03.190084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f8f03ebd-20c0-49ad-90fc-52f59086da12 None None] MFA Rules not processed for user `b54767b9f07341c3aa2ba9a120a62ed0`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:03.191514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f8f03ebd-20c0-49ad-90fc-52f59086da12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:03.266880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 710/1405] 10.222.0.24 () {58 vars in 1039 bytes} [Wed May 25 07:29:03 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:03.277604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e995b7-8cc4-4f20-8e06-2e6fc8921622 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:03.291550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e995b7-8cc4-4f20-8e06-2e6fc8921622 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:03.296736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a764de-607c-47bc-9eed-2136204d0d75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:03.297471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a764de-607c-47bc-9eed-2136204d0d75 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:03.297844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a764de-607c-47bc-9eed-2136204d0d75 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:03.298169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a764de-607c-47bc-9eed-2136204d0d75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:03.307317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a764de-607c-47bc-9eed-2136204d0d75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:03.308975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a764de-607c-47bc-9eed-2136204d0d75 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:03.317209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 696/1406] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:29:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:29:05.298146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9a73-48d6-44b1-9b1d-9d31d37bb877 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:05.316895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9a73-48d6-44b1-9b1d-9d31d37bb877 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:05.316895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be9a73-48d6-44b1-9b1d-9d31d37bb877 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:05.316895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 711/1407] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:05.317195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c1d7-e869-43c5-b8b3-748dee832c78 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:05.317195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c1d7-e869-43c5-b8b3-748dee832c78 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:05.317195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088c1d7-e869-43c5-b8b3-748dee832c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:05.331393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3088c1d7-e869-43c5-b8b3-748dee832c78 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:05.332628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3088c1d7-e869-43c5-b8b3-748dee832c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:05.347585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 697/1408] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:29:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:05.400427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be9a73-48d6-44b1-9b1d-9d31d37bb877 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:05.415558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be9a73-48d6-44b1-9b1d-9d31d37bb877 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:05.423640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181fc462-5625-42f6-8eb0-8983e97c1012 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:05.424295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc462-5625-42f6-8eb0-8983e97c1012 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:05.424607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc462-5625-42f6-8eb0-8983e97c1012 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:05.424882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181fc462-5625-42f6-8eb0-8983e97c1012 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:05.434600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fc462-5625-42f6-8eb0-8983e97c1012 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:05.436197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181fc462-5625-42f6-8eb0-8983e97c1012 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:05.447062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 712/1409] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:15.325046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=55 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:29:15.442174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:29:28.026124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda27dc2-c775-4327-830f-f90f1249400f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:28.026769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda27dc2-c775-4327-830f-f90f1249400f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:28.026769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda27dc2-c775-4327-830f-f90f1249400f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:28.028123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 698/1410] 10.222.0.24 () {54 vars in 918 bytes} [Wed May 25 07:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:28.033283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2040d49-3576-4277-800b-313f1878727d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:28.033747 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2040d49-3576-4277-800b-313f1878727d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:28.033842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2040d49-3576-4277-800b-313f1878727d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:28.051860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e2040d49-3576-4277-800b-313f1878727d None None] MFA Rules not processed for user `762b38d08d2447bfbc968245a5b2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:28.053083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e2040d49-3576-4277-800b-313f1878727d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:28.062530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 713/1411] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 25 07:29:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:28.077055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79d5cd-a0d4-4053-8ea7-cb61aacc14c2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:28.077341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79d5cd-a0d4-4053-8ea7-cb61aacc14c2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:28.077620 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79d5cd-a0d4-4053-8ea7-cb61aacc14c2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:28.079025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 699/1412] 10.222.0.24 () {54 vars in 918 bytes} [Wed May 25 07:29:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:28.083594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a8a4-1231-4b72-b094-3e9e16fff17a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:28.083908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a8a4-1231-4b72-b094-3e9e16fff17a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:28.084181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e2a8a4-1231-4b72-b094-3e9e16fff17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:28.103158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-09e2a8a4-1231-4b72-b094-3e9e16fff17a None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:28.104324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-09e2a8a4-1231-4b72-b094-3e9e16fff17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:28.113522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 714/1413] 10.222.0.24 () {58 vars in 1015 bytes} [Wed May 25 07:29:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:30.766898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64340cc6-ed07-4057-9ad2-474230d17d5f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:30.767476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64340cc6-ed07-4057-9ad2-474230d17d5f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:30.767476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64340cc6-ed07-4057-9ad2-474230d17d5f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:30.768833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 700/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:30.774743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ad82d-2692-4000-8dac-afa4e1257a6a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:30.775189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ad82d-2692-4000-8dac-afa4e1257a6a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:30.775302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9ad82d-2692-4000-8dac-afa4e1257a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:30.793659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cd9ad82d-2692-4000-8dac-afa4e1257a6a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:30.794860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cd9ad82d-2692-4000-8dac-afa4e1257a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:30.802642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 715/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:29:30.844382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64340cc6-ed07-4057-9ad2-474230d17d5f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:30.859543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64340cc6-ed07-4057-9ad2-474230d17d5f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:30.864894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd3b981-6bd9-440f-b18c-5bc0462c3d7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:30.865530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b981-6bd9-440f-b18c-5bc0462c3d7f service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:30.865875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b981-6bd9-440f-b18c-5bc0462c3d7f service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:30.866155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd3b981-6bd9-440f-b18c-5bc0462c3d7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:30.874350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3b981-6bd9-440f-b18c-5bc0462c3d7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:30.875948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd3b981-6bd9-440f-b18c-5bc0462c3d7f service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:30.885494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 701/1416] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:31.845866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf051-0572-4550-b2f9-177ebe9ec3c2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:31.846387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf051-0572-4550-b2f9-177ebe9ec3c2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:31.846387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818cf051-0572-4550-b2f9-177ebe9ec3c2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:31.847669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 716/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:29:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:31.853504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb5c8-c35d-4b9e-a3ab-d061b5d01cdf None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:31.853932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb5c8-c35d-4b9e-a3ab-d061b5d01cdf None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:31.854057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb5c8-c35d-4b9e-a3ab-d061b5d01cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:31.872271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4d8bb5c8-c35d-4b9e-a3ab-d061b5d01cdf None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:31.873484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4d8bb5c8-c35d-4b9e-a3ab-d061b5d01cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:31.881982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 702/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:29:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:32.039421 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf051-0572-4550-b2f9-177ebe9ec3c2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:32.053302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818cf051-0572-4550-b2f9-177ebe9ec3c2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:32.058616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199337a7-c64b-4617-8faa-554555b28cd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:32.059240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199337a7-c64b-4617-8faa-554555b28cd7 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:32.059516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199337a7-c64b-4617-8faa-554555b28cd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:32.059792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199337a7-c64b-4617-8faa-554555b28cd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:32.067758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199337a7-c64b-4617-8faa-554555b28cd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:32.069418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199337a7-c64b-4617-8faa-554555b28cd7 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:32.078638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 717/1419] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:33.007152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742c914-e316-4b36-9367-a45405fad03b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:33.007700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742c914-e316-4b36-9367-a45405fad03b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:33.007700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742c914-e316-4b36-9367-a45405fad03b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:33.009163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 703/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:33.015090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1662-84bc-4739-98f6-30aa6a48a488 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:33.015534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1662-84bc-4739-98f6-30aa6a48a488 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:33.015639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e1662-84bc-4739-98f6-30aa6a48a488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:33.033676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3c8e1662-84bc-4739-98f6-30aa6a48a488 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:33.034864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3c8e1662-84bc-4739-98f6-30aa6a48a488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:33.043206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 718/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:33.192468 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742c914-e316-4b36-9367-a45405fad03b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:33.207281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742c914-e316-4b36-9367-a45405fad03b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:33.213285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d1c43-781e-4a1b-8a9d-d3a85181b2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:33.213920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1c43-781e-4a1b-8a9d-d3a85181b2ea service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:33.214201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1c43-781e-4a1b-8a9d-d3a85181b2ea service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:33.214474 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d1c43-781e-4a1b-8a9d-d3a85181b2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:33.222688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d1c43-781e-4a1b-8a9d-d3a85181b2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:33.224411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d1c43-781e-4a1b-8a9d-d3a85181b2ea service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:33.234100 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 704/1422] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:34.131021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eefb5-ed3f-4073-9893-44ac00061cc3 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:34.131609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eefb5-ed3f-4073-9893-44ac00061cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:34.131777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eefb5-ed3f-4073-9893-44ac00061cc3 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:34.133287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 719/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:34.138301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fc4ff-ebdd-48d3-ad54-749df995449e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:34.138724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fc4ff-ebdd-48d3-ad54-749df995449e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:34.138859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1fc4ff-ebdd-48d3-ad54-749df995449e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:34.156846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fd1fc4ff-ebdd-48d3-ad54-749df995449e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:34.158000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fd1fc4ff-ebdd-48d3-ad54-749df995449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:34.166194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 705/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:34.315923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7eefb5-ed3f-4073-9893-44ac00061cc3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:34.330788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7eefb5-ed3f-4073-9893-44ac00061cc3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:34.336395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c08ca-2aa2-40de-8b7d-286881a29dff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:34.337054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c08ca-2aa2-40de-8b7d-286881a29dff service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:34.337330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c08ca-2aa2-40de-8b7d-286881a29dff service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:34.337599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c08ca-2aa2-40de-8b7d-286881a29dff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:34.345388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c08ca-2aa2-40de-8b7d-286881a29dff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:34.346982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c08ca-2aa2-40de-8b7d-286881a29dff service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:34.356604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 720/1425] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:35.259454 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c8a0b-121c-48e3-a697-02dc704e3a87 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:35.260009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c8a0b-121c-48e3-a697-02dc704e3a87 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:35.260009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c8a0b-121c-48e3-a697-02dc704e3a87 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:35.261418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 706/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:35.266603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af833-240f-4d49-aaae-e04aeaecc7aa None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:35.267010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af833-240f-4d49-aaae-e04aeaecc7aa None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:35.267177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89af833-240f-4d49-aaae-e04aeaecc7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:35.285385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f89af833-240f-4d49-aaae-e04aeaecc7aa None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:35.286577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f89af833-240f-4d49-aaae-e04aeaecc7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:35.295069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 721/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:35.442873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c8a0b-121c-48e3-a697-02dc704e3a87 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:35.457798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c8a0b-121c-48e3-a697-02dc704e3a87 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:35.463730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29fd9f1-f6f1-42d0-a216-92056f982206 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:35.464368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fd9f1-f6f1-42d0-a216-92056f982206 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:35.464683 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fd9f1-f6f1-42d0-a216-92056f982206 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:35.464960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29fd9f1-f6f1-42d0-a216-92056f982206 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:35.473099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fd9f1-f6f1-42d0-a216-92056f982206 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:35.474748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29fd9f1-f6f1-42d0-a216-92056f982206 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:35.484734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 707/1428] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:36.392441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036aa74-9669-4ca0-a22b-b27f764afb80 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:36.393095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036aa74-9669-4ca0-a22b-b27f764afb80 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:36.393095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c036aa74-9669-4ca0-a22b-b27f764afb80 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:36.394450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 722/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:36.400088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73efe0-182c-406d-b19a-708cda770835 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:36.400504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73efe0-182c-406d-b19a-708cda770835 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:36.400673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f73efe0-182c-406d-b19a-708cda770835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:36.418320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6f73efe0-182c-406d-b19a-708cda770835 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:36.419428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6f73efe0-182c-406d-b19a-708cda770835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:36.427028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 708/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:36.573443 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036aa74-9669-4ca0-a22b-b27f764afb80 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:36.588382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c036aa74-9669-4ca0-a22b-b27f764afb80 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:36.593850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fee59-87ad-41fc-b6b9-59f3da95fe13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:36.594487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fee59-87ad-41fc-b6b9-59f3da95fe13 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:36.594764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fee59-87ad-41fc-b6b9-59f3da95fe13 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:36.595033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fee59-87ad-41fc-b6b9-59f3da95fe13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:36.604338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fee59-87ad-41fc-b6b9-59f3da95fe13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:36.605949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fee59-87ad-41fc-b6b9-59f3da95fe13 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:36.615126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 723/1431] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:37.520747 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebfd2c-57d3-426e-8b91-ced3308fb42b None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:37.521302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebfd2c-57d3-426e-8b91-ced3308fb42b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:37.521302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebfd2c-57d3-426e-8b91-ced3308fb42b None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:37.523312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 709/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:29:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:37.528382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8af49-7f64-41d3-9f9b-7d3a09ca0447 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:37.528847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8af49-7f64-41d3-9f9b-7d3a09ca0447 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:37.528957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8af49-7f64-41d3-9f9b-7d3a09ca0447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:37.547054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-42f8af49-7f64-41d3-9f9b-7d3a09ca0447 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:37.548235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-42f8af49-7f64-41d3-9f9b-7d3a09ca0447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:37.556325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 724/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:37.704436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebfd2c-57d3-426e-8b91-ced3308fb42b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:37.719822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebfd2c-57d3-426e-8b91-ced3308fb42b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:37.725418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30baad39-cf0f-419e-b4a2-b2844e8bedd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:37.726120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baad39-cf0f-419e-b4a2-b2844e8bedd7 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:37.726661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baad39-cf0f-419e-b4a2-b2844e8bedd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:37.726942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30baad39-cf0f-419e-b4a2-b2844e8bedd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:37.735433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baad39-cf0f-419e-b4a2-b2844e8bedd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:37.737091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30baad39-cf0f-419e-b4a2-b2844e8bedd7 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:37.746554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 710/1434] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:38.695712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ea05d-400c-4e08-a355-4c7c8005bea2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:38.696274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ea05d-400c-4e08-a355-4c7c8005bea2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:38.696274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ea05d-400c-4e08-a355-4c7c8005bea2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:38.697765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 725/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:38.702694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d5a9a-d3fe-41fb-a928-f2191c8b52c3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:38.703129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d5a9a-d3fe-41fb-a928-f2191c8b52c3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:38.703251 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d5a9a-d3fe-41fb-a928-f2191c8b52c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:38.721915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2e2d5a9a-d3fe-41fb-a928-f2191c8b52c3 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:38.723049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2e2d5a9a-d3fe-41fb-a928-f2191c8b52c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:38.731269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 711/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:38.882003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ea05d-400c-4e08-a355-4c7c8005bea2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:38.896144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ea05d-400c-4e08-a355-4c7c8005bea2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:38.901625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110ee03-06cc-4ae4-b7b3-47eee00eda3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:38.902260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ee03-06cc-4ae4-b7b3-47eee00eda3f service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:38.902542 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ee03-06cc-4ae4-b7b3-47eee00eda3f service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:38.902819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110ee03-06cc-4ae4-b7b3-47eee00eda3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:38.910787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110ee03-06cc-4ae4-b7b3-47eee00eda3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:38.912403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110ee03-06cc-4ae4-b7b3-47eee00eda3f service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:38.923449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 726/1437] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:39.819245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db989c39-a94e-4856-82e3-9b7e7bb62843 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:39.819813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db989c39-a94e-4856-82e3-9b7e7bb62843 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:39.819813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db989c39-a94e-4856-82e3-9b7e7bb62843 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:39.821205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 712/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:39.826111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb9599-f31d-47ae-8962-2484fd21cef1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:39.826523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb9599-f31d-47ae-8962-2484fd21cef1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:39.826660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb9599-f31d-47ae-8962-2484fd21cef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:39.844824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b7fb9599-f31d-47ae-8962-2484fd21cef1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:39.845931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b7fb9599-f31d-47ae-8962-2484fd21cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:39.854491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 727/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:40.001887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db989c39-a94e-4856-82e3-9b7e7bb62843 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:40.017407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db989c39-a94e-4856-82e3-9b7e7bb62843 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:40.023645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766c997-7fb8-4239-9dfd-8f8553436f0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:40.024284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c997-7fb8-4239-9dfd-8f8553436f0d service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:40.024601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c997-7fb8-4239-9dfd-8f8553436f0d service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:40.024881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766c997-7fb8-4239-9dfd-8f8553436f0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:40.033243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766c997-7fb8-4239-9dfd-8f8553436f0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:40.034822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4766c997-7fb8-4239-9dfd-8f8553436f0d service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:40.044934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 713/1440] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:42.128837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea416a-82a6-4177-ae21-b277de02e990 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:42.129408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea416a-82a6-4177-ae21-b277de02e990 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:42.129408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea416a-82a6-4177-ae21-b277de02e990 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:42.130756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 728/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:42.136770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabdc04-2b7f-49a4-9ff0-f1ba3fcfc4ea None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:42.137226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabdc04-2b7f-49a4-9ff0-f1ba3fcfc4ea None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:42.137325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dabdc04-2b7f-49a4-9ff0-f1ba3fcfc4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:42.155378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7dabdc04-2b7f-49a4-9ff0-f1ba3fcfc4ea None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:42.156606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7dabdc04-2b7f-49a4-9ff0-f1ba3fcfc4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:42.165328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 714/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:42.203120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea416a-82a6-4177-ae21-b277de02e990 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:42.214319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea416a-82a6-4177-ae21-b277de02e990 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:42.217776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa2d6f-76c6-4dc4-902e-3d845ac5a3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:42.218400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa2d6f-76c6-4dc4-902e-3d845ac5a3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:42.218679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa2d6f-76c6-4dc4-902e-3d845ac5a3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:42.218948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa2d6f-76c6-4dc4-902e-3d845ac5a3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:42.228176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa2d6f-76c6-4dc4-902e-3d845ac5a3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:42.229661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa2d6f-76c6-4dc4-902e-3d845ac5a3e3 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:42.238931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 729/1443] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:44.674069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdad78-8954-4285-b4ff-f0c94e1bb859 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:44.674611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdad78-8954-4285-b4ff-f0c94e1bb859 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:44.674611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdad78-8954-4285-b4ff-f0c94e1bb859 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:44.676015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 715/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:44.681430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7a708-4dc0-4a4a-b37a-4c329f537f38 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:44.681867 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7a708-4dc0-4a4a-b37a-4c329f537f38 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:44.681973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7a708-4dc0-4a4a-b37a-4c329f537f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:44.699821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2bd7a708-4dc0-4a4a-b37a-4c329f537f38 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:44.701042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2bd7a708-4dc0-4a4a-b37a-4c329f537f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:44.708775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 730/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:44.746861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdad78-8954-4285-b4ff-f0c94e1bb859 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:44.748533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fcbdad78-8954-4285-b4ff-f0c94e1bb859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:44.761689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdad78-8954-4285-b4ff-f0c94e1bb859 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:44.765113 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16461293-ac0a-4525-a423-4d292cc99f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:44.765737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16461293-ac0a-4525-a423-4d292cc99f09 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:44.766015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16461293-ac0a-4525-a423-4d292cc99f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:44.766285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16461293-ac0a-4525-a423-4d292cc99f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:44.775696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16461293-ac0a-4525-a423-4d292cc99f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:44.777153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16461293-ac0a-4525-a423-4d292cc99f09 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:44.786548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 716/1446] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:47.346285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d88fa-0d4d-4b04-961e-03a718890ae2 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:47.346975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d88fa-0d4d-4b04-961e-03a718890ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:47.346975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878d88fa-0d4d-4b04-961e-03a718890ae2 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:47.348231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 731/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:47.354967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a936-bb86-4561-88c3-7915607cfc2a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:47.355434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a936-bb86-4561-88c3-7915607cfc2a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:47.355591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872a936-bb86-4561-88c3-7915607cfc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:47.374284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9872a936-bb86-4561-88c3-7915607cfc2a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:47.375477 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9872a936-bb86-4561-88c3-7915607cfc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:47.384131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 717/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:47.424918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d88fa-0d4d-4b04-961e-03a718890ae2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:47.433470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878d88fa-0d4d-4b04-961e-03a718890ae2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:47.436931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc913a-79fc-4e76-ab6b-fe797ed0df08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:47.437556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc913a-79fc-4e76-ab6b-fe797ed0df08 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:47.437834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc913a-79fc-4e76-ab6b-fe797ed0df08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:47.438105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc913a-79fc-4e76-ab6b-fe797ed0df08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:47.447525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc913a-79fc-4e76-ab6b-fe797ed0df08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:47.448993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc913a-79fc-4e76-ab6b-fe797ed0df08 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:47.458128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 732/1449] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:49.780835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba0d62-2e46-4ac7-8045-9a091248fcb9 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:49.781406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba0d62-2e46-4ac7-8045-9a091248fcb9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:49.781406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ba0d62-2e46-4ac7-8045-9a091248fcb9 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:49.782769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 718/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:49.788782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e80001-8f8d-4bb4-9b54-9b259b3e944a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:49.789219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e80001-8f8d-4bb4-9b54-9b259b3e944a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:49.789327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e80001-8f8d-4bb4-9b54-9b259b3e944a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:49.807453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d4e80001-8f8d-4bb4-9b54-9b259b3e944a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:49.808675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d4e80001-8f8d-4bb4-9b54-9b259b3e944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:49.816325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 733/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:29:49.854420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba0d62-2e46-4ac7-8045-9a091248fcb9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:49.865025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ba0d62-2e46-4ac7-8045-9a091248fcb9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:49.869268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964d2c2-f03d-4743-b5c0-c741946c5684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:49.869897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964d2c2-f03d-4743-b5c0-c741946c5684 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:49.870177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964d2c2-f03d-4743-b5c0-c741946c5684 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:49.870451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964d2c2-f03d-4743-b5c0-c741946c5684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:49.879224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964d2c2-f03d-4743-b5c0-c741946c5684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:49.880671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964d2c2-f03d-4743-b5c0-c741946c5684 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:49.889995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 719/1452] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:52.265652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a787475-1b40-4dcb-b9d9-a30278eb3d19 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:52.266217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a787475-1b40-4dcb-b9d9-a30278eb3d19 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:52.266217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a787475-1b40-4dcb-b9d9-a30278eb3d19 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:52.267561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 734/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:52.273234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e024cf-1adf-4e57-a2f9-00306d240250 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:52.273667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e024cf-1adf-4e57-a2f9-00306d240250 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:52.273784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e024cf-1adf-4e57-a2f9-00306d240250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:52.292379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f6e024cf-1adf-4e57-a2f9-00306d240250 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:52.299208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f6e024cf-1adf-4e57-a2f9-00306d240250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:52.306351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 720/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:52.343623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a787475-1b40-4dcb-b9d9-a30278eb3d19 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:52.355194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a787475-1b40-4dcb-b9d9-a30278eb3d19 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:52.358653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3e8ef-2be0-4df1-926b-569302c3f771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:52.359281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e8ef-2be0-4df1-926b-569302c3f771 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:52.359562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e8ef-2be0-4df1-926b-569302c3f771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:52.359835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3e8ef-2be0-4df1-926b-569302c3f771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:52.368657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3e8ef-2be0-4df1-926b-569302c3f771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:52.370124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3e8ef-2be0-4df1-926b-569302c3f771 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:52.379321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 735/1455] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:54.647578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6b587-2930-47bd-8772-94157fdba731 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:54.648105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6b587-2930-47bd-8772-94157fdba731 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:54.648105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6b587-2930-47bd-8772-94157fdba731 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:54.649541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 721/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:29:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:54.654726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2e438-153c-44bb-9202-01773298d463 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:54.655109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2e438-153c-44bb-9202-01773298d463 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:54.655287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a2e438-153c-44bb-9202-01773298d463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:54.673258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-71a2e438-153c-44bb-9202-01773298d463 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:54.674434 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-71a2e438-153c-44bb-9202-01773298d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:54.682281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 736/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:29:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:54.719238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6b587-2930-47bd-8772-94157fdba731 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:54.730746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6b587-2930-47bd-8772-94157fdba731 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:54.734158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d9bb7-3fa6-433d-91ad-a8ec35dc4a9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:54.734810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d9bb7-3fa6-433d-91ad-a8ec35dc4a9b service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:54.735092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d9bb7-3fa6-433d-91ad-a8ec35dc4a9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:54.735373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d9bb7-3fa6-433d-91ad-a8ec35dc4a9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:54.744208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d9bb7-3fa6-433d-91ad-a8ec35dc4a9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:54.745650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d9bb7-3fa6-433d-91ad-a8ec35dc4a9b service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:54.754923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 722/1458] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:57.114349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f9292-c127-44e8-af73-d850babd4f11 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:57.114936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f9292-c127-44e8-af73-d850babd4f11 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:57.115103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f9292-c127-44e8-af73-d850babd4f11 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:57.116432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 737/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:29:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:29:57.121681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704d297-6bef-4e63-be97-f133155284ed None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:57.122121 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704d297-6bef-4e63-be97-f133155284ed None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:57.122228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0704d297-6bef-4e63-be97-f133155284ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:57.128323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=70 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:29:57.140672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0704d297-6bef-4e63-be97-f133155284ed None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:57.141922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0704d297-6bef-4e63-be97-f133155284ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:57.150167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 723/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:29:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:29:57.186803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f9292-c127-44e8-af73-d850babd4f11 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:57.192216 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=73 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:29:57.198287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f9292-c127-44e8-af73-d850babd4f11 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:57.207534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22feddb-43bc-4530-b76e-4e3fb674f599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:57.207534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22feddb-43bc-4530-b76e-4e3fb674f599 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:57.207534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22feddb-43bc-4530-b76e-4e3fb674f599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:57.207534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22feddb-43bc-4530-b76e-4e3fb674f599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:57.212613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22feddb-43bc-4530-b76e-4e3fb674f599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:57.214205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22feddb-43bc-4530-b76e-4e3fb674f599 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:57.227056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 738/1461] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:29:59.454854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc417c2-1097-40b6-962e-583ecb039c87 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:59.455435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc417c2-1097-40b6-962e-583ecb039c87 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:59.455435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc417c2-1097-40b6-962e-583ecb039c87 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:59.456817 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 724/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:29:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:29:59.462435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf447e87-d74a-4e79-aba3-74639ba7a796 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:59.462840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf447e87-d74a-4e79-aba3-74639ba7a796 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:59.462988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf447e87-d74a-4e79-aba3-74639ba7a796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:59.481281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cf447e87-d74a-4e79-aba3-74639ba7a796 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:29:59.482459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cf447e87-d74a-4e79-aba3-74639ba7a796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:29:59.490728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 739/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:29:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:29:59.527200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc417c2-1097-40b6-962e-583ecb039c87 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:29:59.538426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc417c2-1097-40b6-962e-583ecb039c87 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:29:59.541871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc14b20-6986-4345-bb11-af1a6a9204d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:29:59.542501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14b20-6986-4345-bb11-af1a6a9204d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:29:59.542781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14b20-6986-4345-bb11-af1a6a9204d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:29:59.543056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc14b20-6986-4345-bb11-af1a6a9204d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:29:59.551665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc14b20-6986-4345-bb11-af1a6a9204d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:29:59.554049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc14b20-6986-4345-bb11-af1a6a9204d7 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:29:59.563503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 725/1464] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:29:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:30:01.777984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad6287-aff5-4f4b-8912-c8f811edb805 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:01.778588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad6287-aff5-4f4b-8912-c8f811edb805 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:01.778588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad6287-aff5-4f4b-8912-c8f811edb805 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:01.779926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 740/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:30:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:01.785332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669cba7-5e0a-4771-970c-e3c8e8328804 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:01.785765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669cba7-5e0a-4771-970c-e3c8e8328804 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:01.785879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669cba7-5e0a-4771-970c-e3c8e8328804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:01.803969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7669cba7-5e0a-4771-970c-e3c8e8328804 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:01.805209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7669cba7-5e0a-4771-970c-e3c8e8328804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:01.813360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 726/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:30:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:30:01.851217 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad6287-aff5-4f4b-8912-c8f811edb805 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:30:01.861985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad6287-aff5-4f4b-8912-c8f811edb805 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:30:01.866091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a8922-7bd7-459d-8e25-f49c22a63ec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:30:01.866717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a8922-7bd7-459d-8e25-f49c22a63ec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:01.866995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a8922-7bd7-459d-8e25-f49c22a63ec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:01.867267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a8922-7bd7-459d-8e25-f49c22a63ec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:01.876002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a8922-7bd7-459d-8e25-f49c22a63ec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:30:01.877463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a8922-7bd7-459d-8e25-f49c22a63ec1 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:30:01.886635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 741/1467] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:30:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:30:04.096069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c192c-4a5f-49b1-91b0-03c750afe330 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:04.096671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c192c-4a5f-49b1-91b0-03c750afe330 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:04.096671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186c192c-4a5f-49b1-91b0-03c750afe330 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:04.098051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 727/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:04.104153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4e115-3fc8-435e-b0a1-7a332d248100 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:04.104602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4e115-3fc8-435e-b0a1-7a332d248100 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:04.104745 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e4e115-3fc8-435e-b0a1-7a332d248100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:04.122604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-65e4e115-3fc8-435e-b0a1-7a332d248100 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:04.123785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-65e4e115-3fc8-435e-b0a1-7a332d248100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:04.131519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 742/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:30:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:30:04.166977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c192c-4a5f-49b1-91b0-03c750afe330 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:30:04.178097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186c192c-4a5f-49b1-91b0-03c750afe330 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:30:04.182022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9691e-fb75-496d-9181-3a70bd80ff90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:30:04.182653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9691e-fb75-496d-9181-3a70bd80ff90 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:04.182930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9691e-fb75-496d-9181-3a70bd80ff90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:04.183202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9691e-fb75-496d-9181-3a70bd80ff90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:04.191976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9691e-fb75-496d-9181-3a70bd80ff90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:30:04.193588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9691e-fb75-496d-9181-3a70bd80ff90 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:30:04.202746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 728/1470] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:30:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:30:14.117537 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=17 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:30:14.198653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=17 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:30:37.662455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55bc3-1782-4c49-81bd-3d6e4a2c3bc1 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:37.663022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55bc3-1782-4c49-81bd-3d6e4a2c3bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:37.663022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55bc3-1782-4c49-81bd-3d6e4a2c3bc1 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:37.664383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 743/1471] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:37.669837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450dc46-6fa8-42f8-a588-f53b6f605ff3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:37.670301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450dc46-6fa8-42f8-a588-f53b6f605ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:37.670409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4450dc46-6fa8-42f8-a588-f53b6f605ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:37.689321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4450dc46-6fa8-42f8-a588-f53b6f605ff3 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:37.690533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4450dc46-6fa8-42f8-a588-f53b6f605ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:37.699387 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 729/1472] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:30:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:30:37.746399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66050c1-058a-484c-8336-4eb9dc3e3898 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:37.746954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66050c1-058a-484c-8336-4eb9dc3e3898 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:37.747417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66050c1-058a-484c-8336-4eb9dc3e3898 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:37.749284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 744/1473] 10.222.0.24 () {54 vars in 962 bytes} [Wed May 25 07:30:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:37.754181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e411ba-f568-4f8f-8fcf-a7765e3ed6a9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:37.754802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e411ba-f568-4f8f-8fcf-a7765e3ed6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:37.755079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e411ba-f568-4f8f-8fcf-a7765e3ed6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:37.773172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-17e411ba-f568-4f8f-8fcf-a7765e3ed6a9 None None] MFA Rules not processed for user `451754f5553e4b9783b4e75f6d408ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:37.774362 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-17e411ba-f568-4f8f-8fcf-a7765e3ed6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:37.780882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 730/1474] 10.222.0.24 () {58 vars in 1059 bytes} [Wed May 25 07:30:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:30:37.788631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66050c1-058a-484c-8336-4eb9dc3e3898 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:30:37.804614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66050c1-058a-484c-8336-4eb9dc3e3898 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:30:37.808709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee39369-6df5-4842-bf37-149261162742 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451754f5553e4b9783b4e75f6d408ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:30:37.809361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee39369-6df5-4842-bf37-149261162742 service glance] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:37.809647 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee39369-6df5-4842-bf37-149261162742 service glance] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:37.809933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee39369-6df5-4842-bf37-149261162742 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:37.820887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee39369-6df5-4842-bf37-149261162742 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:30:37.822357 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee39369-6df5-4842-bf37-149261162742 service glance] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:30:37.834346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 745/1475] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:30:40.137941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93537f-dde9-43f9-b6af-657c9b5ea1b8 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:40.138510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93537f-dde9-43f9-b6af-657c9b5ea1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:40.138510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e93537f-dde9-43f9-b6af-657c9b5ea1b8 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:40.139865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 731/1476] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:40.145176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e815373-feb2-48d9-af06-e389160e40c4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:40.145829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e815373-feb2-48d9-af06-e389160e40c4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:40.145829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e815373-feb2-48d9-af06-e389160e40c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:40.164133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0e815373-feb2-48d9-af06-e389160e40c4 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:40.165367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0e815373-feb2-48d9-af06-e389160e40c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:40.173197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 746/1477] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:30:40.196894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93537f-dde9-43f9-b6af-657c9b5ea1b8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:30:40.209378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e93537f-dde9-43f9-b6af-657c9b5ea1b8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:30:40.213756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8baf9-da58-4b30-8599-59154dcea84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:30:40.214397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8baf9-da58-4b30-8599-59154dcea84e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:40.214685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8baf9-da58-4b30-8599-59154dcea84e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:40.214960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8baf9-da58-4b30-8599-59154dcea84e admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:40.215693 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8baf9-da58-4b30-8599-59154dcea84e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:30:40.217521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING py.warnings [None req-43f8baf9-da58-4b30-8599-59154dcea84e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:30:40.217521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: warnings.warn(msg) May 25 07:30:40.217521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: May 25 07:30:40.218675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8baf9-da58-4b30-8599-59154dcea84e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:30:40.239670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 732/1478] 10.222.0.24 () {56 vars in 1108 bytes} [Wed May 25 07:30:40 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:30:42.460819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240de317-f8a4-497c-8ade-c06a6a22a4ed None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:42.461353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240de317-f8a4-497c-8ade-c06a6a22a4ed None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:42.461353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240de317-f8a4-497c-8ade-c06a6a22a4ed None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:42.462769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 747/1479] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:42.468062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd7aef-aef8-4fec-ae75-b0ad7610da38 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:42.468521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd7aef-aef8-4fec-ae75-b0ad7610da38 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:42.468642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd7aef-aef8-4fec-ae75-b0ad7610da38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:42.487916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e6cd7aef-aef8-4fec-ae75-b0ad7610da38 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:42.489986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e6cd7aef-aef8-4fec-ae75-b0ad7610da38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:42.497921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 733/1480] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:30:42.547559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240de317-f8a4-497c-8ade-c06a6a22a4ed None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:30:42.561832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240de317-f8a4-497c-8ade-c06a6a22a4ed None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:30:42.567503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbec7b6f-5b39-4a94-96d2-fb7f92de8a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:30:42.568139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec7b6f-5b39-4a94-96d2-fb7f92de8a89 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:42.568419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec7b6f-5b39-4a94-96d2-fb7f92de8a89 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:42.568732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbec7b6f-5b39-4a94-96d2-fb7f92de8a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:42.576874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec7b6f-5b39-4a94-96d2-fb7f92de8a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:30:42.578450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbec7b6f-5b39-4a94-96d2-fb7f92de8a89 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:30:42.588946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 748/1481] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:30:44.966919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293799-6fe7-4619-b40f-6ef1ea87939f None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:44.967469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293799-6fe7-4619-b40f-6ef1ea87939f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:44.967469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a293799-6fe7-4619-b40f-6ef1ea87939f None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:44.968885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 734/1482] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:30:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:44.974457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fcbb0-1605-4160-adcd-ca80eb23791e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:44.974896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fcbb0-1605-4160-adcd-ca80eb23791e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:44.975005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fcbb0-1605-4160-adcd-ca80eb23791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:44.994097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-395fcbb0-1605-4160-adcd-ca80eb23791e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:44.995294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-395fcbb0-1605-4160-adcd-ca80eb23791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:45.003016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 749/1483] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:30:45.038602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a293799-6fe7-4619-b40f-6ef1ea87939f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:30:45.049278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a293799-6fe7-4619-b40f-6ef1ea87939f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:30:45.053670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cceb2fc1-4973-4a6a-b971-b6b797169e5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:30:45.054307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2fc1-4973-4a6a-b971-b6b797169e5a service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:45.054590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2fc1-4973-4a6a-b971-b6b797169e5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:45.054866 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cceb2fc1-4973-4a6a-b971-b6b797169e5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:45.063639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb2fc1-4973-4a6a-b971-b6b797169e5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:30:45.065113 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cceb2fc1-4973-4a6a-b971-b6b797169e5a service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:30:45.075374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 735/1484] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:30:47.373264 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96558ae-980d-4544-8de2-95e78e41c0fa None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:47.373835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96558ae-980d-4544-8de2-95e78e41c0fa None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:47.373835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96558ae-980d-4544-8de2-95e78e41c0fa None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:47.375209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 750/1485] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:47.380653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce015f-b651-4dac-91bb-455bc71f0810 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:47.381096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce015f-b651-4dac-91bb-455bc71f0810 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:47.381207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbce015f-b651-4dac-91bb-455bc71f0810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:47.399106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-cbce015f-b651-4dac-91bb-455bc71f0810 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:47.400279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cbce015f-b651-4dac-91bb-455bc71f0810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:47.407869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 736/1486] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:30:47.445680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96558ae-980d-4544-8de2-95e78e41c0fa None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:30:47.456295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96558ae-980d-4544-8de2-95e78e41c0fa None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:30:47.460663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f493db4-dd7f-4ec4-b0b6-d742a97880e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:30:47.461295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493db4-dd7f-4ec4-b0b6-d742a97880e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:47.461579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493db4-dd7f-4ec4-b0b6-d742a97880e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:47.461853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f493db4-dd7f-4ec4-b0b6-d742a97880e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:47.470921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f493db4-dd7f-4ec4-b0b6-d742a97880e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:30:47.472356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f493db4-dd7f-4ec4-b0b6-d742a97880e7 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:30:47.482098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 751/1487] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:30:49.847465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae23e-a380-453c-a7e0-5884b50f76db None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:49.848717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae23e-a380-453c-a7e0-5884b50f76db None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:49.848717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ae23e-a380-453c-a7e0-5884b50f76db None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:49.849978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 737/1488] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:30:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:49.855714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aabec7-ba86-4568-8b48-ef0c8933cca8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:49.856149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aabec7-ba86-4568-8b48-ef0c8933cca8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:49.856293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aabec7-ba86-4568-8b48-ef0c8933cca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:49.879041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c5aabec7-ba86-4568-8b48-ef0c8933cca8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:49.880250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c5aabec7-ba86-4568-8b48-ef0c8933cca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:49.888053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 752/1489] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:30:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:30:49.928841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae23e-a380-453c-a7e0-5884b50f76db None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:30:49.939324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ae23e-a380-453c-a7e0-5884b50f76db None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:30:49.942850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0ea48-7d3e-4835-8a59-fb0631db5d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:30:49.943473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0ea48-7d3e-4835-8a59-fb0631db5d86 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:49.943753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0ea48-7d3e-4835-8a59-fb0631db5d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:49.944038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0ea48-7d3e-4835-8a59-fb0631db5d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:49.952766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0ea48-7d3e-4835-8a59-fb0631db5d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:30:49.954204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0ea48-7d3e-4835-8a59-fb0631db5d86 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:30:49.963411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 738/1490] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:30:52.618652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfd1e6-0a60-4d1c-a365-dabe1d346f1d None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:52.619121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfd1e6-0a60-4d1c-a365-dabe1d346f1d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:52.619234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dfd1e6-0a60-4d1c-a365-dabe1d346f1d None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:52.620567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 753/1491] 10.222.0.24 () {54 vars in 926 bytes} [Wed May 25 07:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:30:52.625800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da04444-2a62-46ee-bd41-a11bab8fd838 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:52.626245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da04444-2a62-46ee-bd41-a11bab8fd838 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:52.626353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da04444-2a62-46ee-bd41-a11bab8fd838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:52.644378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5da04444-2a62-46ee-bd41-a11bab8fd838 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:30:52.645628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5da04444-2a62-46ee-bd41-a11bab8fd838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:30:52.653218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 739/1492] 10.222.0.24 () {58 vars in 1023 bytes} [Wed May 25 07:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:30:52.694634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfd1e6-0a60-4d1c-a365-dabe1d346f1d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:30:52.705460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dfd1e6-0a60-4d1c-a365-dabe1d346f1d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:30:52.709410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70211ae-5cc6-484e-89e4-258c7cf1bc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:30:52.710829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70211ae-5cc6-484e-89e4-258c7cf1bc8f service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:30:52.710829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70211ae-5cc6-484e-89e4-258c7cf1bc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:30:52.710829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70211ae-5cc6-484e-89e4-258c7cf1bc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:30:52.719584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70211ae-5cc6-484e-89e4-258c7cf1bc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:30:52.721085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70211ae-5cc6-484e-89e4-258c7cf1bc8f service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:30:52.731789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 754/1493] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:31:02.639217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=33 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:31:02.727489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=33 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:32:44.396615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f05de-d83e-4359-a093-82cd614f910d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:44.397229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f05de-d83e-4359-a093-82cd614f910d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:44.397229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562f05de-d83e-4359-a093-82cd614f910d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:44.414796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-562f05de-d83e-4359-a093-82cd614f910d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:32:44.415968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-562f05de-d83e-4359-a093-82cd614f910d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:32:44.423594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 740/1494] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:32:44.432832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d6127-efe3-42f7-899b-ba43dc6ef979 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:44.433326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d6127-efe3-42f7-899b-ba43dc6ef979 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:44.433433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d6127-efe3-42f7-899b-ba43dc6ef979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:44.451477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-dd9d6127-efe3-42f7-899b-ba43dc6ef979 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:32:44.452688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dd9d6127-efe3-42f7-899b-ba43dc6ef979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:32:44.461491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 755/1495] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:32:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:32:44.465690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f05de-d83e-4359-a093-82cd614f910d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:44.475107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562f05de-d83e-4359-a093-82cd614f910d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:44.479849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:44.480505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:44.480798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:44.481068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:44.481784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:32:44.482087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:44.483088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING py.warnings [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:32:44.483088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: warnings.warn(msg) May 25 07:32:44.483088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: May 25 07:32:44.483977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:44.495293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 741/1496] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:32:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:32:44.504435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d6127-efe3-42f7-899b-ba43dc6ef979 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:44.513569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d6127-efe3-42f7-899b-ba43dc6ef979 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:44.518722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005b0f6-7ba6-46fb-bc90-f1974478e4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:44.519361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005b0f6-7ba6-46fb-bc90-f1974478e4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:44.519639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005b0f6-7ba6-46fb-bc90-f1974478e4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:44.519907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2005b0f6-7ba6-46fb-bc90-f1974478e4b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:44.520708 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005b0f6-7ba6-46fb-bc90-f1974478e4b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:44.522529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: WARNING py.warnings [None req-2005b0f6-7ba6-46fb-bc90-f1974478e4b6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:32:44.522529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: warnings.warn(msg) May 25 07:32:44.522529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: May 25 07:32:44.523717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2005b0f6-7ba6-46fb-bc90-f1974478e4b6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:44.618581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 756/1497] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:32:44 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:32:44.622572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:44.632865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0dd3e6-8555-4b1e-b991-28997a47354f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:44.686526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e7664-b73f-4cce-85f9-cccb48521c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:44.687180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e7664-b73f-4cce-85f9-cccb48521c16 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:44.687462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e7664-b73f-4cce-85f9-cccb48521c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:44.687737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e7664-b73f-4cce-85f9-cccb48521c16 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:44.688427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e7664-b73f-4cce-85f9-cccb48521c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:44.689458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING py.warnings [None req-2f0e7664-b73f-4cce-85f9-cccb48521c16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:32:44.689458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: warnings.warn(msg) May 25 07:32:44.689458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: May 25 07:32:44.691299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e7664-b73f-4cce-85f9-cccb48521c16 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:44.800495 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 742/1498] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:32:44 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:32:44.804461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005b0f6-7ba6-46fb-bc90-f1974478e4b6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:44.815565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2005b0f6-7ba6-46fb-bc90-f1974478e4b6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:44.820238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c67-fb0d-44cb-900d-157f911d5f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:44.820924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c67-fb0d-44cb-900d-157f911d5f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:44.821206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c67-fb0d-44cb-900d-157f911d5f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:44.821504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8532c67-fb0d-44cb-900d-157f911d5f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:44.822227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532c67-fb0d-44cb-900d-157f911d5f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:44.823245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: WARNING py.warnings [None req-e8532c67-fb0d-44cb-900d-157f911d5f79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:32:44.823245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: warnings.warn(msg) May 25 07:32:44.823245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: May 25 07:32:44.824195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8532c67-fb0d-44cb-900d-157f911d5f79 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:44.837033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 757/1499] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:32:44.841091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e7664-b73f-4cce-85f9-cccb48521c16 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:44.851112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e7664-b73f-4cce-85f9-cccb48521c16 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:44.855826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d433c58-a86f-4cfe-8097-a284b4a06248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:44.856534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d433c58-a86f-4cfe-8097-a284b4a06248 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:44.856819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d433c58-a86f-4cfe-8097-a284b4a06248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:44.857095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d433c58-a86f-4cfe-8097-a284b4a06248 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:44.857814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d433c58-a86f-4cfe-8097-a284b4a06248 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:44.858826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING py.warnings [None req-4d433c58-a86f-4cfe-8097-a284b4a06248 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:32:44.858826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: warnings.warn(msg) May 25 07:32:44.858826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: May 25 07:32:44.859710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d433c58-a86f-4cfe-8097-a284b4a06248 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:44.873373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 743/1500] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:32:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:32:44.877391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c67-fb0d-44cb-900d-157f911d5f79 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:44.888810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8532c67-fb0d-44cb-900d-157f911d5f79 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:44.893446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852d9cc-b01c-48ca-9cc8-b336ac59939a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:44.894324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d9cc-b01c-48ca-9cc8-b336ac59939a admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:44.894604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d9cc-b01c-48ca-9cc8-b336ac59939a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:44.894878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d9cc-b01c-48ca-9cc8-b336ac59939a admin admin] PATH_INFO: `/v3/projects/173b77bcb06a4fdea144b69c739ec973/users/e4ae4083e358405384c85fb821331503/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:44.909548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852d9cc-b01c-48ca-9cc8-b336ac59939a admin admin] RBAC: Authorizing `identity:create_grant(project_id=173b77bcb06a4fdea144b69c739ec973, user_id=e4ae4083e358405384c85fb821331503, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:44.910723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: WARNING py.warnings [None req-a852d9cc-b01c-48ca-9cc8-b336ac59939a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:32:44.910723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: warnings.warn(msg) May 25 07:32:44.910723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: May 25 07:32:44.912753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852d9cc-b01c-48ca-9cc8-b336ac59939a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:44.979328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 758/1501] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:32:44 2022] PUT /identity/v3/projects/173b77bcb06a4fdea144b69c739ec973/users/e4ae4083e358405384c85fb821331503/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:32:45.005112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5c43a-9a1f-448c-913e-7338b878ec36 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:45.005416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5c43a-9a1f-448c-913e-7338b878ec36 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:45.005685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5c43a-9a1f-448c-913e-7338b878ec36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:45.031515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5ef5c43a-9a1f-448c-913e-7338b878ec36 None None] MFA Rules not processed for user `e4ae4083e358405384c85fb821331503`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:32:45.032750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5ef5c43a-9a1f-448c-913e-7338b878ec36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:32:45.095111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 744/1502] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:32:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:32:45.108905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b5b25-5ae8-4a6d-a9bf-de4ab6b071aa None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:45.109197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b5b25-5ae8-4a6d-a9bf-de4ab6b071aa None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:45.109471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b5b25-5ae8-4a6d-a9bf-de4ab6b071aa None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:45.110824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 759/1503] 10.222.0.24 () {54 vars in 963 bytes} [Wed May 25 07:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:32:45.116429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714922b-bc70-411d-a0c1-9e3e75db95d4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:45.116746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714922b-bc70-411d-a0c1-9e3e75db95d4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:45.117025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7714922b-bc70-411d-a0c1-9e3e75db95d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:45.134409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7714922b-bc70-411d-a0c1-9e3e75db95d4 None None] MFA Rules not processed for user `e08e18aa7d0941f9892986e737ba9e98`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:32:45.135594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7714922b-bc70-411d-a0c1-9e3e75db95d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:32:45.178682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:32:45.185796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 745/1504] 10.222.0.24 () {58 vars in 1060 bytes} [Wed May 25 07:32:45 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:32:45.193613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b5b25-5ae8-4a6d-a9bf-de4ab6b071aa None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:45.204083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b5b25-5ae8-4a6d-a9bf-de4ab6b071aa None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:45.208034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccddc71-8a18-46ef-9d68-7cc85f79c2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:45.208724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccddc71-8a18-46ef-9d68-7cc85f79c2db service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:45.209006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccddc71-8a18-46ef-9d68-7cc85f79c2db service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:45.209279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccddc71-8a18-46ef-9d68-7cc85f79c2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:45.217470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccddc71-8a18-46ef-9d68-7cc85f79c2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:45.218893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccddc71-8a18-46ef-9d68-7cc85f79c2db service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:45.228560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 760/1505] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:32:45 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:32:45.271245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905448ca-c61f-48de-b41b-19c84a0401c7 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:45.271523 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905448ca-c61f-48de-b41b-19c84a0401c7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:45.271796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905448ca-c61f-48de-b41b-19c84a0401c7 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:45.273194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 746/1506] 10.222.0.24 () {52 vars in 829 bytes} [Wed May 25 07:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:32:45.276791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccddc71-8a18-46ef-9d68-7cc85f79c2db service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:45.337845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccddc71-8a18-46ef-9d68-7cc85f79c2db service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:45.342290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:45.343156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:45.343446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:45.343753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] PATH_INFO: `/v3/users/e4ae4083e358405384c85fb821331503` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:45.344958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4ae4083e358405384c85fb821331503)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:45.346580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: WARNING py.warnings [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:32:45.346580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: warnings.warn(msg) May 25 07:32:45.346580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: May 25 07:32:45.348017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:45.777590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4ae4083e358405384c85fb821331503'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:45.796447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4ae4083e358405384c85fb821331503'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:45.862795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4ae4083e358405384c85fb821331503'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:45.863325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4ae4083e358405384c85fb821331503'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:45.864035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4ae4083e358405384c85fb821331503'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:45.873063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:32:45.883210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 761/1507] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:32:45 2022] DELETE /identity/v3/users/e4ae4083e358405384c85fb821331503 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:32:45.887641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66709dcc-6dac-4f37-9706-6e02d6a8b61c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:45.888170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66709dcc-6dac-4f37-9706-6e02d6a8b61c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:45.888170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66709dcc-6dac-4f37-9706-6e02d6a8b61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:45.905889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-66709dcc-6dac-4f37-9706-6e02d6a8b61c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:32:45.907068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-66709dcc-6dac-4f37-9706-6e02d6a8b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:32:45.966063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 747/1508] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:32:45.975756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:45.977904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:32:46.035458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b60fc7a-65a5-4548-b31d-11c4d2cbbedf admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:46.039092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526237f4-ea80-4815-ab1c-fecc4e52b75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:46.039736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526237f4-ea80-4815-ab1c-fecc4e52b75d service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:46.040021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526237f4-ea80-4815-ab1c-fecc4e52b75d service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:46.040299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526237f4-ea80-4815-ab1c-fecc4e52b75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:46.049225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526237f4-ea80-4815-ab1c-fecc4e52b75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:46.050892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526237f4-ea80-4815-ab1c-fecc4e52b75d service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:46.060213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 762/1509] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:32:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:32:46.551242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66709dcc-6dac-4f37-9706-6e02d6a8b61c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:32:46.552919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-66709dcc-6dac-4f37-9706-6e02d6a8b61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:32:46.565516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66709dcc-6dac-4f37-9706-6e02d6a8b61c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:32:46.571110 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:32:46.572084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:32:46.572512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:32:46.572656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] PATH_INFO: `/v3/projects/173b77bcb06a4fdea144b69c739ec973` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:32:46.573869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173b77bcb06a4fdea144b69c739ec973)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:32:46.575810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING py.warnings [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:32:46.575810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: warnings.warn(msg) May 25 07:32:46.575810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: May 25 07:32:46.577074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:32:46.697951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173b77bcb06a4fdea144b69c739ec973', 'request_id': 'req-2753e31f-54e1-4011-b45c-2825413372e6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:46.712023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173b77bcb06a4fdea144b69c739ec973', 'request_id': 'req-2753e31f-54e1-4011-b45c-2825413372e6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:46.718120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173b77bcb06a4fdea144b69c739ec973', 'request_id': 'req-2753e31f-54e1-4011-b45c-2825413372e6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:46.812842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] The token cache is being invalidate because project 173b77bcb06a4fdea144b69c739ec973 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:32:46.813068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:46.813745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-2753e31f-54e1-4011-b45c-2825413372e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:32:46.817685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 748/1510] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:32:46 2022] DELETE /identity/v3/projects/173b77bcb06a4fdea144b69c739ec973 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:32:56.056064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=29 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:32:56.809695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:34:26.865548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627436d-2c5f-4d7a-a8c7-e6a557aa5267 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:26.866128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627436d-2c5f-4d7a-a8c7-e6a557aa5267 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:26.866128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627436d-2c5f-4d7a-a8c7-e6a557aa5267 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:26.867447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 763/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:34:26.872395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c8b70-42f2-4fec-9ad3-7fff9572cb75 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:26.872861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c8b70-42f2-4fec-9ad3-7fff9572cb75 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:26.872992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c8b70-42f2-4fec-9ad3-7fff9572cb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:26.898647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d08c8b70-42f2-4fec-9ad3-7fff9572cb75 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:26.900227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d08c8b70-42f2-4fec-9ad3-7fff9572cb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:26.978016 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 749/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:34:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:34:27.168065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627436d-2c5f-4d7a-a8c7-e6a557aa5267 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:34:27.169798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a627436d-2c5f-4d7a-a8c7-e6a557aa5267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:27.255763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a627436d-2c5f-4d7a-a8c7-e6a557aa5267 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:34:27.269002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83df9f0-d168-45be-a179-2770dfca41b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:34:27.269381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df9f0-d168-45be-a179-2770dfca41b0 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:27.269546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df9f0-d168-45be-a179-2770dfca41b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:27.269748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83df9f0-d168-45be-a179-2770dfca41b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:27.281731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83df9f0-d168-45be-a179-2770dfca41b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:34:27.283363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83df9f0-d168-45be-a179-2770dfca41b0 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:34:27.293317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 764/1513] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:34:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:34:28.173934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178177e-5e78-4953-b823-30055aa4e15c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:28.174525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178177e-5e78-4953-b823-30055aa4e15c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:28.174525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178177e-5e78-4953-b823-30055aa4e15c None None] PATH_INFO: `/v3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:28.176453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 750/1514] 10.222.0.41 () {54 vars in 925 bytes} [Wed May 25 07:34:28 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:34:28.183172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5e55d-5d5c-4779-bf7a-9446d1ad880a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:28.183601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5e55d-5d5c-4779-bf7a-9446d1ad880a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:28.183739 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5e55d-5d5c-4779-bf7a-9446d1ad880a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:28.202361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cba5e55d-5d5c-4779-bf7a-9446d1ad880a None None] MFA Rules not processed for user `762b38d08d2447bfbc968245a5b2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:28.203548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cba5e55d-5d5c-4779-bf7a-9446d1ad880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:28.215455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361be0-81ac-4b3d-9db8-8126aa48e2b1 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:28.215780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361be0-81ac-4b3d-9db8-8126aa48e2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:28.216067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba361be0-81ac-4b3d-9db8-8126aa48e2b1 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:28.217500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 751/1515] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:34:28.222082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fcdb4-9156-49ba-ac1c-7a8d05da0094 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:28.222559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fcdb4-9156-49ba-ac1c-7a8d05da0094 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:28.222876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548fcdb4-9156-49ba-ac1c-7a8d05da0094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:28.241795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-548fcdb4-9156-49ba-ac1c-7a8d05da0094 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:28.243234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-548fcdb4-9156-49ba-ac1c-7a8d05da0094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:28.250978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 752/1516] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:34:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:34:28.266062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 765/1517] 10.222.0.41 () {58 vars in 1015 bytes} [Wed May 25 07:34:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:34:28.401174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fcdb4-9156-49ba-ac1c-7a8d05da0094 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:34:28.413341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548fcdb4-9156-49ba-ac1c-7a8d05da0094 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:34:28.418633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b66dc-9f25-420b-b306-4e088b98bb48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:34:28.419296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b66dc-9f25-420b-b306-4e088b98bb48 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:28.419576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b66dc-9f25-420b-b306-4e088b98bb48 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:28.419849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b66dc-9f25-420b-b306-4e088b98bb48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:28.428515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b66dc-9f25-420b-b306-4e088b98bb48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:34:28.430047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b66dc-9f25-420b-b306-4e088b98bb48 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:34:28.439571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 753/1518] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:34:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:34:37.247407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cb85a-f637-4156-b1f2-04cf3ac0a2ef None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:37.247964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cb85a-f637-4156-b1f2-04cf3ac0a2ef None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:37.247964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331cb85a-f637-4156-b1f2-04cf3ac0a2ef None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:37.249407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 766/1519] 10.222.0.24 () {54 vars in 960 bytes} [Wed May 25 07:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:34:37.255188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7db2f-9b12-4c61-85e9-b2247ba72efb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:37.255633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7db2f-9b12-4c61-85e9-b2247ba72efb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:37.255730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7db2f-9b12-4c61-85e9-b2247ba72efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:37.273298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d5e7db2f-9b12-4c61-85e9-b2247ba72efb None None] MFA Rules not processed for user `762b38d08d2447bfbc968245a5b2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:37.274488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d5e7db2f-9b12-4c61-85e9-b2247ba72efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:37.282878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 754/1520] 10.222.0.24 () {58 vars in 1057 bytes} [Wed May 25 07:34:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:34:37.290294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cb85a-f637-4156-b1f2-04cf3ac0a2ef None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:34:37.304051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331cb85a-f637-4156-b1f2-04cf3ac0a2ef None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:34:37.309007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b971f111-502f-4225-99c5-99d1248af344 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:34:37.309637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971f111-502f-4225-99c5-99d1248af344 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:37.309923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971f111-502f-4225-99c5-99d1248af344 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:37.310201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b971f111-502f-4225-99c5-99d1248af344 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:37.319226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971f111-502f-4225-99c5-99d1248af344 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:34:37.320857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b971f111-502f-4225-99c5-99d1248af344 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:34:37.330353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 767/1521] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:34:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:34:39.716106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdd905-7289-4647-a719-a2a34f146712 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:39.716692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdd905-7289-4647-a719-a2a34f146712 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:39.716806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdd905-7289-4647-a719-a2a34f146712 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:39.718139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 755/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:34:39.723409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc810c-8fa6-4281-8f7c-289bb08f6cdc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:39.723864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc810c-8fa6-4281-8f7c-289bb08f6cdc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:39.723995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc810c-8fa6-4281-8f7c-289bb08f6cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:39.742108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-64cc810c-8fa6-4281-8f7c-289bb08f6cdc None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:39.743313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-64cc810c-8fa6-4281-8f7c-289bb08f6cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:39.751110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 768/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:34:39.903604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdd905-7289-4647-a719-a2a34f146712 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:34:39.917816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdd905-7289-4647-a719-a2a34f146712 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:34:39.923325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d4f3d-4da4-4dee-a21b-0ca6df6d34e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:34:39.923957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d4f3d-4da4-4dee-a21b-0ca6df6d34e7 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:39.924249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d4f3d-4da4-4dee-a21b-0ca6df6d34e7 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:39.924672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d4f3d-4da4-4dee-a21b-0ca6df6d34e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:39.932938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d4f3d-4da4-4dee-a21b-0ca6df6d34e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:34:39.934546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d4f3d-4da4-4dee-a21b-0ca6df6d34e7 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:34:39.944663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 756/1524] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:34:40.819479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b91b-3d82-4237-8ca3-5a0eb870cf2a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:40.820016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b91b-3d82-4237-8ca3-5a0eb870cf2a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:40.820016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9b91b-3d82-4237-8ca3-5a0eb870cf2a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:40.821473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 769/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 07:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:34:40.826191 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7512a-1ccd-440d-8b80-aaa17e6601a4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:40.826651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7512a-1ccd-440d-8b80-aaa17e6601a4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:40.826757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7512a-1ccd-440d-8b80-aaa17e6601a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:40.844372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-98a7512a-1ccd-440d-8b80-aaa17e6601a4 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:40.845590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-98a7512a-1ccd-440d-8b80-aaa17e6601a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:40.854082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 757/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 07:34:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:34:41.005383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9b91b-3d82-4237-8ca3-5a0eb870cf2a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:34:41.020073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9b91b-3d82-4237-8ca3-5a0eb870cf2a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:34:41.025506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39beba91-9109-41c4-bf3d-0de4e683fee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:34:41.026140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39beba91-9109-41c4-bf3d-0de4e683fee2 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:41.026447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39beba91-9109-41c4-bf3d-0de4e683fee2 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:41.026720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39beba91-9109-41c4-bf3d-0de4e683fee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:41.035736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39beba91-9109-41c4-bf3d-0de4e683fee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:34:41.037363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39beba91-9109-41c4-bf3d-0de4e683fee2 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:34:41.046679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 770/1527] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:34:45.110826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d81053-6214-42c9-86a8-599195495283 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:45.111403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d81053-6214-42c9-86a8-599195495283 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:45.111403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d81053-6214-42c9-86a8-599195495283 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:45.112796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 758/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:34:45.118002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255f7ad-ac98-4df1-90b6-c77660a901e8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:45.118400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255f7ad-ac98-4df1-90b6-c77660a901e8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:45.118560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255f7ad-ac98-4df1-90b6-c77660a901e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:45.136599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a255f7ad-ac98-4df1-90b6-c77660a901e8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:45.137778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a255f7ad-ac98-4df1-90b6-c77660a901e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:45.146365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 771/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:34:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:34:45.182483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d81053-6214-42c9-86a8-599195495283 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:34:45.184153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c5d81053-6214-42c9-86a8-599195495283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:45.241957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d81053-6214-42c9-86a8-599195495283 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:34:45.245442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605c1f5b-71e1-473d-9270-84a6bb215ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:34:45.246080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c1f5b-71e1-473d-9270-84a6bb215ecd service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:45.246365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c1f5b-71e1-473d-9270-84a6bb215ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:45.246642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c1f5b-71e1-473d-9270-84a6bb215ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:45.256385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c1f5b-71e1-473d-9270-84a6bb215ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:34:45.257841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605c1f5b-71e1-473d-9270-84a6bb215ecd service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:34:45.267084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 759/1530] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:34:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:34:47.423858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452106c-ff5d-4905-bab7-52fdfccbdc9b None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:47.424376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452106c-ff5d-4905-bab7-52fdfccbdc9b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:47.424376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452106c-ff5d-4905-bab7-52fdfccbdc9b None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:47.425847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 772/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:34:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:34:47.431052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904361ae-0aec-4c05-9e63-71a9c8126728 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:47.431511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904361ae-0aec-4c05-9e63-71a9c8126728 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:47.431644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904361ae-0aec-4c05-9e63-71a9c8126728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:47.437911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=75 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:34:47.450521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-904361ae-0aec-4c05-9e63-71a9c8126728 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:47.451719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-904361ae-0aec-4c05-9e63-71a9c8126728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:47.460277 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 760/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:34:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:34:47.497370 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452106c-ff5d-4905-bab7-52fdfccbdc9b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:34:47.499025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b452106c-ff5d-4905-bab7-52fdfccbdc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:47.512611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452106c-ff5d-4905-bab7-52fdfccbdc9b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:34:47.516093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5dd0-fcf8-4ee8-9851-6e2fcf97828c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:34:47.516760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5dd0-fcf8-4ee8-9851-6e2fcf97828c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:47.517044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5dd0-fcf8-4ee8-9851-6e2fcf97828c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:47.517319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5dd0-fcf8-4ee8-9851-6e2fcf97828c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:47.526829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5dd0-fcf8-4ee8-9851-6e2fcf97828c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:34:47.528249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5dd0-fcf8-4ee8-9851-6e2fcf97828c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:34:47.537798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 773/1533] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:34:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:34:51.278611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c84c55-a1bf-4545-91e6-01f0d4253369 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:51.279185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c84c55-a1bf-4545-91e6-01f0d4253369 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:51.279185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c84c55-a1bf-4545-91e6-01f0d4253369 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:51.280633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 761/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:34:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:34:51.286772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042cea2-f93b-48e6-a363-e4959473a158 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:51.287198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042cea2-f93b-48e6-a363-e4959473a158 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:51.287334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042cea2-f93b-48e6-a363-e4959473a158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:51.305739 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3042cea2-f93b-48e6-a363-e4959473a158 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:51.306942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3042cea2-f93b-48e6-a363-e4959473a158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:51.314869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 774/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:34:51.587319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c84c55-a1bf-4545-91e6-01f0d4253369 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:34:51.589041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-63c84c55-a1bf-4545-91e6-01f0d4253369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:51.648240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c84c55-a1bf-4545-91e6-01f0d4253369 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:34:51.651708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868e85d-cce9-4436-acd4-c395774ec581 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:34:51.652344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868e85d-cce9-4436-acd4-c395774ec581 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:51.652657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868e85d-cce9-4436-acd4-c395774ec581 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:51.652930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868e85d-cce9-4436-acd4-c395774ec581 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:51.662322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868e85d-cce9-4436-acd4-c395774ec581 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:34:51.663772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868e85d-cce9-4436-acd4-c395774ec581 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:34:51.673018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 762/1536] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:34:53.891945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee7997-ccb1-452a-a711-323de5f18f68 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:53.892558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee7997-ccb1-452a-a711-323de5f18f68 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:53.892558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee7997-ccb1-452a-a711-323de5f18f68 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:53.894473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 775/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 07:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:34:53.899806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b24ebc-bd61-4a8a-9e85-f34cb59a049c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:53.900239 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b24ebc-bd61-4a8a-9e85-f34cb59a049c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:53.900341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b24ebc-bd61-4a8a-9e85-f34cb59a049c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:53.920002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d8b24ebc-bd61-4a8a-9e85-f34cb59a049c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:34:53.925870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d8b24ebc-bd61-4a8a-9e85-f34cb59a049c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:53.929138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 763/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 07:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:34:54.205202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee7997-ccb1-452a-a711-323de5f18f68 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:34:54.207470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f0ee7997-ccb1-452a-a711-323de5f18f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:34:54.220121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ee7997-ccb1-452a-a711-323de5f18f68 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:34:54.223843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bf3a1b-8d9c-40cc-adc8-149a7199dc5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:34:54.224469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3a1b-8d9c-40cc-adc8-149a7199dc5f service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:34:54.224774 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3a1b-8d9c-40cc-adc8-149a7199dc5f service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:34:54.225045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf3a1b-8d9c-40cc-adc8-149a7199dc5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:34:54.233955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf3a1b-8d9c-40cc-adc8-149a7199dc5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:34:54.235379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bf3a1b-8d9c-40cc-adc8-149a7199dc5f service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:34:54.244723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 776/1539] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:35:03.913351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=31 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:35:04.240725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:23.133898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128725af-2624-4b86-8ac5-cffb59eab3db None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.134535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128725af-2624-4b86-8ac5-cffb59eab3db None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.134535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128725af-2624-4b86-8ac5-cffb59eab3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.163887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-128725af-2624-4b86-8ac5-cffb59eab3db None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.165159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-128725af-2624-4b86-8ac5-cffb59eab3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.183950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 764/1540] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:36:23.195292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a3678-4aae-46cf-942c-51c0009e36e2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.195873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a3678-4aae-46cf-942c-51c0009e36e2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.195873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a3678-4aae-46cf-942c-51c0009e36e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.212047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa20c1-cf44-4fe5-a93c-51eab5d2a235 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.212748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa20c1-cf44-4fe5-a93c-51eab5d2a235 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.213042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa20c1-cf44-4fe5-a93c-51eab5d2a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.225112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-031a3678-4aae-46cf-942c-51c0009e36e2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.226527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-031a3678-4aae-46cf-942c-51c0009e36e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.239717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b0aa20c1-cf44-4fe5-a93c-51eab5d2a235 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.240977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b0aa20c1-cf44-4fe5-a93c-51eab5d2a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.242615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 777/1541] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.251198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a3678-4aae-46cf-942c-51c0009e36e2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:23.253848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 765/1542] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:36:23.261840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a3678-4aae-46cf-942c-51c0009e36e2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:23.265314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1a693-c439-4637-abce-6952967c1365 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.265688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1a693-c439-4637-abce-6952967c1365 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.266082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e1a693-c439-4637-abce-6952967c1365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.278795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55429174-8da3-4a2f-abf6-fc49ea32cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:23.279620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55429174-8da3-4a2f-abf6-fc49ea32cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.280466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55429174-8da3-4a2f-abf6-fc49ea32cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.281492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55429174-8da3-4a2f-abf6-fc49ea32cd2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.282261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55429174-8da3-4a2f-abf6-fc49ea32cd2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:23.282570 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55429174-8da3-4a2f-abf6-fc49ea32cd2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:23.283634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: WARNING py.warnings [None req-55429174-8da3-4a2f-abf6-fc49ea32cd2d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:36:23.283634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: warnings.warn(msg) May 25 07:36:23.283634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: May 25 07:36:23.284571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55429174-8da3-4a2f-abf6-fc49ea32cd2d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:23.297992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c6e1a693-c439-4637-abce-6952967c1365 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.298794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 778/1543] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:36:23.299320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c6e1a693-c439-4637-abce-6952967c1365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.300277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6147e-6843-4c38-8862-af92627cfd7a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.300624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6147e-6843-4c38-8862-af92627cfd7a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.300864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6147e-6843-4c38-8862-af92627cfd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.319894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 766/1544] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:36:23.320779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1a693-c439-4637-abce-6952967c1365 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:23.341117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e1a693-c439-4637-abce-6952967c1365 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:23.344656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5cc6147e-6843-4c38-8862-af92627cfd7a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.345871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5cc6147e-6843-4c38-8862-af92627cfd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.357744 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b36ab-809d-499c-b9c9-7f90d673a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:23.358425 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b36ab-809d-499c-b9c9-7f90d673a277 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.358766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b36ab-809d-499c-b9c9-7f90d673a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.359548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626b36ab-809d-499c-b9c9-7f90d673a277 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.360538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b36ab-809d-499c-b9c9-7f90d673a277 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:23.361570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING py.warnings [None req-626b36ab-809d-499c-b9c9-7f90d673a277 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:36:23.361570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: warnings.warn(msg) May 25 07:36:23.361570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: May 25 07:36:23.362773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626b36ab-809d-499c-b9c9-7f90d673a277 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:23.370574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 779/1545] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.371196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6147e-6843-4c38-8862-af92627cfd7a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:23.393180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6147e-6843-4c38-8862-af92627cfd7a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:23.402939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86cc06c-7e6d-456d-99c6-90fc9cf53660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:23.403646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cc06c-7e6d-456d-99c6-90fc9cf53660 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.403919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cc06c-7e6d-456d-99c6-90fc9cf53660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.404194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86cc06c-7e6d-456d-99c6-90fc9cf53660 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.405086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cc06c-7e6d-456d-99c6-90fc9cf53660 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:23.405387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cc06c-7e6d-456d-99c6-90fc9cf53660 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:23.408325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86cc06c-7e6d-456d-99c6-90fc9cf53660 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:23.432840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 780/1546] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:23.434179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b5b51-e5b8-461c-b10c-8d02ae7afa70 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.434466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b5b51-e5b8-461c-b10c-8d02ae7afa70 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.434805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b5b51-e5b8-461c-b10c-8d02ae7afa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.463054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-886b5b51-e5b8-461c-b10c-8d02ae7afa70 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.465259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-886b5b51-e5b8-461c-b10c-8d02ae7afa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.474406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 781/1547] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.475569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee973ab7-bc38-4e38-bb8f-966e31b49fb7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.475855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee973ab7-bc38-4e38-bb8f-966e31b49fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.476126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee973ab7-bc38-4e38-bb8f-966e31b49fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.495452 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 767/1548] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/projects => generated 385 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:23.496088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b36ab-809d-499c-b9c9-7f90d673a277 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:23.500794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ee973ab7-bc38-4e38-bb8f-966e31b49fb7 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.502438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ee973ab7-bc38-4e38-bb8f-966e31b49fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.579341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626b36ab-809d-499c-b9c9-7f90d673a277 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:23.582318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 782/1549] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.583901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a96bf9-c24c-4790-b82b-2b9e8397e8d1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.584382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a96bf9-c24c-4790-b82b-2b9e8397e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.584932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a96bf9-c24c-4790-b82b-2b9e8397e8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.593300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bc06fe-bc33-4803-9e3a-aeeaefab644b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:23.599423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc06fe-bc33-4803-9e3a-aeeaefab644b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.599423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc06fe-bc33-4803-9e3a-aeeaefab644b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.599423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bc06fe-bc33-4803-9e3a-aeeaefab644b admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.599423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc06fe-bc33-4803-9e3a-aeeaefab644b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:23.599423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bc06fe-bc33-4803-9e3a-aeeaefab644b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:23.605382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-58a96bf9-c24c-4790-b82b-2b9e8397e8d1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.606597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-58a96bf9-c24c-4790-b82b-2b9e8397e8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.615527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 783/1550] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.616940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af024-971d-4806-b5c0-ce3515447208 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.617773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af024-971d-4806-b5c0-ce3515447208 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.618056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608af024-971d-4806-b5c0-ce3515447208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.636876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-608af024-971d-4806-b5c0-ce3515447208 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.638060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-608af024-971d-4806-b5c0-ce3515447208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.646627 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 784/1551] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.647294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608af024-971d-4806-b5c0-ce3515447208 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:23.657457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608af024-971d-4806-b5c0-ce3515447208 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:23.662008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f531d18-3b93-459b-b499-4b865f776421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:23.662641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f531d18-3b93-459b-b499-4b865f776421 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.662917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f531d18-3b93-459b-b499-4b865f776421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.663186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f531d18-3b93-459b-b499-4b865f776421 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.663852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f531d18-3b93-459b-b499-4b865f776421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:23.664907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: WARNING py.warnings [None req-3f531d18-3b93-459b-b499-4b865f776421 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:36:23.664907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: warnings.warn(msg) May 25 07:36:23.664907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: May 25 07:36:23.666151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f531d18-3b93-459b-b499-4b865f776421 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:23.728530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 768/1552] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/projects => generated 379 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:23.728530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fbf1-5857-4a4b-a299-77153537e074 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.728530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fbf1-5857-4a4b-a299-77153537e074 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.729085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9fbf1-5857-4a4b-a299-77153537e074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.746207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-08e9fbf1-5857-4a4b-a299-77153537e074 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.750854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-08e9fbf1-5857-4a4b-a299-77153537e074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.804912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 769/1553] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.806190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b03a3-3c09-4cba-89d5-d716842c43ad None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.806481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b03a3-3c09-4cba-89d5-d716842c43ad None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.806758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092b03a3-3c09-4cba-89d5-d716842c43ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.818923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 785/1554] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:23.818923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd68c-9591-45a2-bd9a-b4f003e9b6ea None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.818923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd68c-9591-45a2-bd9a-b4f003e9b6ea None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.818923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbbd68c-9591-45a2-bd9a-b4f003e9b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.825608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-092b03a3-3c09-4cba-89d5-d716842c43ad None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.826845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-092b03a3-3c09-4cba-89d5-d716842c43ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.835365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 770/1555] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.835960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8dbbd68c-9591-45a2-bd9a-b4f003e9b6ea None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.836210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b03a3-3c09-4cba-89d5-d716842c43ad None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:23.837277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8dbbd68c-9591-45a2-bd9a-b4f003e9b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.848686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 786/1556] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.849794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbfce0-ed98-4658-ba1f-9d77b6f8c86b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.850078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbfce0-ed98-4658-ba1f-9d77b6f8c86b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.850472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfbfce0-ed98-4658-ba1f-9d77b6f8c86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.851717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092b03a3-3c09-4cba-89d5-d716842c43ad None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:23.856646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4d643-004d-4bef-9100-0e66b2670fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:23.857305 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4d643-004d-4bef-9100-0e66b2670fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.857584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4d643-004d-4bef-9100-0e66b2670fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.857862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4d643-004d-4bef-9100-0e66b2670fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.858651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4d643-004d-4bef-9100-0e66b2670fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:23.859017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4d643-004d-4bef-9100-0e66b2670fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:23.862635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4d643-004d-4bef-9100-0e66b2670fd1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:23.869099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5cfbfce0-ed98-4658-ba1f-9d77b6f8c86b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.870399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5cfbfce0-ed98-4658-ba1f-9d77b6f8c86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.874043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 771/1557] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:23.874897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4d643-004d-4bef-9100-0e66b2670fd1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:23.878691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 787/1558] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.879288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbfce0-ed98-4658-ba1f-9d77b6f8c86b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:23.888794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfbfce0-ed98-4658-ba1f-9d77b6f8c86b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:23.890600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4d643-004d-4bef-9100-0e66b2670fd1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:23.894195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a54737-9ac7-4135-9baf-1b9994296b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:23.894865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a54737-9ac7-4135-9baf-1b9994296b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.895149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a54737-9ac7-4135-9baf-1b9994296b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.895419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a54737-9ac7-4135-9baf-1b9994296b11 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.895625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8ca8b-eebe-41a3-b620-155729a02bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:23.896110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a54737-9ac7-4135-9baf-1b9994296b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:23.896277 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ca8b-eebe-41a3-b620-155729a02bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.896593 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ca8b-eebe-41a3-b620-155729a02bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.896952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8ca8b-eebe-41a3-b620-155729a02bf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.897628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8ca8b-eebe-41a3-b620-155729a02bf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:23.897938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8ca8b-eebe-41a3-b620-155729a02bf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:23.898275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a54737-9ac7-4135-9baf-1b9994296b11 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:23.899513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8ca8b-eebe-41a3-b620-155729a02bf3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:23.912641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 772/1559] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:23.914184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaad00-dc28-4b69-a87c-2ff72a887e6b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.914472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaad00-dc28-4b69-a87c-2ff72a887e6b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.914748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eaad00-dc28-4b69-a87c-2ff72a887e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.932200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-83eaad00-dc28-4b69-a87c-2ff72a887e6b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.933486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-83eaad00-dc28-4b69-a87c-2ff72a887e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:23.942360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 773/1560] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:23.946087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eaad00-dc28-4b69-a87c-2ff72a887e6b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:23.948672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:23.952276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eaad00-dc28-4b69-a87c-2ff72a887e6b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:23.957704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e84555-84ba-409f-967f-d0d0320e60b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:23.958337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84555-84ba-409f-967f-d0d0320e60b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.958616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84555-84ba-409f-967f-d0d0320e60b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.958889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e84555-84ba-409f-967f-d0d0320e60b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.959599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e84555-84ba-409f-967f-d0d0320e60b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:23.961221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e84555-84ba-409f-967f-d0d0320e60b4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:23.972862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 774/1561] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:23.974039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb393e-fc12-49fb-bcae-0877f6bb6b25 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:23.975214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb393e-fc12-49fb-bcae-0877f6bb6b25 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:23.975214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb393e-fc12-49fb-bcae-0877f6bb6b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:23.992237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b2cb393e-fc12-49fb-bcae-0877f6bb6b25 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:23.993462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b2cb393e-fc12-49fb-bcae-0877f6bb6b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:24.002813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 775/1562] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:24.009764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0949334-d09b-4055-a166-a8ea2d65e060 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.009764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0949334-d09b-4055-a166-a8ea2d65e060 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.009764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0949334-d09b-4055-a166-a8ea2d65e060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.010078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 788/1563] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:23 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:24.010078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a54737-9ac7-4135-9baf-1b9994296b11 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.016858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a54737-9ac7-4135-9baf-1b9994296b11 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.021469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570aa47-a883-4c4a-a533-b082ff2412a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.022124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570aa47-a883-4c4a-a533-b082ff2412a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.022408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570aa47-a883-4c4a-a533-b082ff2412a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.022682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570aa47-a883-4c4a-a533-b082ff2412a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.023364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570aa47-a883-4c4a-a533-b082ff2412a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.025215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c0949334-d09b-4055-a166-a8ea2d65e060 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:24.025500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570aa47-a883-4c4a-a533-b082ff2412a6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.027331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c0949334-d09b-4055-a166-a8ea2d65e060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:24.035276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 776/1564] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:24.036052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0949334-d09b-4055-a166-a8ea2d65e060 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.045505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0949334-d09b-4055-a166-a8ea2d65e060 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.050186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd147288-7baa-4804-a8fa-634478fc9018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.050819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd147288-7baa-4804-a8fa-634478fc9018 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.051098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd147288-7baa-4804-a8fa-634478fc9018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.051417 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd147288-7baa-4804-a8fa-634478fc9018 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.052227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd147288-7baa-4804-a8fa-634478fc9018 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:24.052555 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd147288-7baa-4804-a8fa-634478fc9018 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.054194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd147288-7baa-4804-a8fa-634478fc9018 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.066062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 777/1565] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:24.072892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd147288-7baa-4804-a8fa-634478fc9018 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.076164 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd147288-7baa-4804-a8fa-634478fc9018 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.081569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b3941-73a5-4b62-92f9-3d0e14ea0807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.082180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b3941-73a5-4b62-92f9-3d0e14ea0807 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.082504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b3941-73a5-4b62-92f9-3d0e14ea0807 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.082782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957b3941-73a5-4b62-92f9-3d0e14ea0807 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.083446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b3941-73a5-4b62-92f9-3d0e14ea0807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.085311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957b3941-73a5-4b62-92f9-3d0e14ea0807 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.131689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 789/1566] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:24 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:24.132348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570aa47-a883-4c4a-a533-b082ff2412a6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.164462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:24.191722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570aa47-a883-4c4a-a533-b082ff2412a6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.196256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5793-b842-49e8-b930-d0658568c7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.196932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5793-b842-49e8-b930-d0658568c7da admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.197219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5793-b842-49e8-b930-d0658568c7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.197492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c5793-b842-49e8-b930-d0658568c7da admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.198214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5793-b842-49e8-b930-d0658568c7da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:24.198512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5793-b842-49e8-b930-d0658568c7da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.200115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c5793-b842-49e8-b930-d0658568c7da admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.206042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 778/1567] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:24 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:24.210438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b3941-73a5-4b62-92f9-3d0e14ea0807 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.213871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 790/1568] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:24.214800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5793-b842-49e8-b930-d0658568c7da admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.234751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c5793-b842-49e8-b930-d0658568c7da admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.269779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957b3941-73a5-4b62-92f9-3d0e14ea0807 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.274435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dd4c2-e468-427e-86ba-6b60a2541882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.275101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dd4c2-e468-427e-86ba-6b60a2541882 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.275385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dd4c2-e468-427e-86ba-6b60a2541882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.275662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74dd4c2-e468-427e-86ba-6b60a2541882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.276448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dd4c2-e468-427e-86ba-6b60a2541882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.278203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74dd4c2-e468-427e-86ba-6b60a2541882 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.288899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 779/1569] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:24.289759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dd4c2-e468-427e-86ba-6b60a2541882 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.294922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ebed8-63a3-4109-9131-98589b823544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.295594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ebed8-63a3-4109-9131-98589b823544 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.295912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ebed8-63a3-4109-9131-98589b823544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.296938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3ebed8-63a3-4109-9131-98589b823544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.297591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ebed8-63a3-4109-9131-98589b823544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.299310 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3ebed8-63a3-4109-9131-98589b823544 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.300338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74dd4c2-e468-427e-86ba-6b60a2541882 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.304895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7639-67d0-4b65-8d1c-afa105781e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.305533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7639-67d0-4b65-8d1c-afa105781e15 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.305816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7639-67d0-4b65-8d1c-afa105781e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.306097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229f7639-67d0-4b65-8d1c-afa105781e15 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.306818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f7639-67d0-4b65-8d1c-afa105781e15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:24.307124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f7639-67d0-4b65-8d1c-afa105781e15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.308709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229f7639-67d0-4b65-8d1c-afa105781e15 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.309288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 791/1570] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:24.310154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ebed8-63a3-4109-9131-98589b823544 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.320989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3ebed8-63a3-4109-9131-98589b823544 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.322853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 780/1571] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:24.325353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7639-67d0-4b65-8d1c-afa105781e15 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.325661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45712-8055-4484-a212-94cb16922f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.326313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45712-8055-4484-a212-94cb16922f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.326602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45712-8055-4484-a212-94cb16922f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.326883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45712-8055-4484-a212-94cb16922f35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.327691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c45712-8055-4484-a212-94cb16922f35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:24.328004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c45712-8055-4484-a212-94cb16922f35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.329645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c45712-8055-4484-a212-94cb16922f35 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.337024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229f7639-67d0-4b65-8d1c-afa105781e15 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.341637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff15596-85b4-4a7a-98fd-32a7d396e47a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.342276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff15596-85b4-4a7a-98fd-32a7d396e47a admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.342383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 792/1572] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:24.342563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff15596-85b4-4a7a-98fd-32a7d396e47a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.342843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff15596-85b4-4a7a-98fd-32a7d396e47a admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.343657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45712-8055-4484-a212-94cb16922f35 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.344284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff15596-85b4-4a7a-98fd-32a7d396e47a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.346206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff15596-85b4-4a7a-98fd-32a7d396e47a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.356796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45712-8055-4484-a212-94cb16922f35 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.362274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa2734-6f88-499e-b2bf-eb71c9e5c901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.362937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa2734-6f88-499e-b2bf-eb71c9e5c901 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.363220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa2734-6f88-499e-b2bf-eb71c9e5c901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.363496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aa2734-6f88-499e-b2bf-eb71c9e5c901 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.364232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa2734-6f88-499e-b2bf-eb71c9e5c901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.366360 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53aa2734-6f88-499e-b2bf-eb71c9e5c901 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.485918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 781/1573] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:24 2022] POST /identity/v3/projects => generated 363 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:24.486879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff15596-85b4-4a7a-98fd-32a7d396e47a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.547161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff15596-85b4-4a7a-98fd-32a7d396e47a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.548606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 793/1574] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:24 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:24.549254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa2734-6f88-499e-b2bf-eb71c9e5c901 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.554906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf91f2c-97d8-4fd5-bc51-a45e6aad5ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.555582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91f2c-97d8-4fd5-bc51-a45e6aad5ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.557102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91f2c-97d8-4fd5-bc51-a45e6aad5ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.557102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf91f2c-97d8-4fd5-bc51-a45e6aad5ea4 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.557454 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf91f2c-97d8-4fd5-bc51-a45e6aad5ea4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.558988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aa2734-6f88-499e-b2bf-eb71c9e5c901 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.559190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf91f2c-97d8-4fd5-bc51-a45e6aad5ea4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.564014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68180a7-53ea-4b74-8337-9b86360a69b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.564743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68180a7-53ea-4b74-8337-9b86360a69b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.565030 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68180a7-53ea-4b74-8337-9b86360a69b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.565303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68180a7-53ea-4b74-8337-9b86360a69b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.566009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68180a7-53ea-4b74-8337-9b86360a69b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.567929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68180a7-53ea-4b74-8337-9b86360a69b4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.569222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:24.662334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 782/1575] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:24 2022] POST /identity/v3/users => generated 296 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:24.663144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf91f2c-97d8-4fd5-bc51-a45e6aad5ea4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.672856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf91f2c-97d8-4fd5-bc51-a45e6aad5ea4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.677455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9454177-608b-4e80-8e71-0c6542fd651a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.678322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9454177-608b-4e80-8e71-0c6542fd651a admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.678604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9454177-608b-4e80-8e71-0c6542fd651a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.678880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9454177-608b-4e80-8e71-0c6542fd651a admin admin] PATH_INFO: `/v3/projects/2d8e35800ce043acbcb027ce406ed2e7/users/0487ea9076ee4baf8138fdc25ce02522/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.693626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9454177-608b-4e80-8e71-0c6542fd651a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8e35800ce043acbcb027ce406ed2e7, user_id=0487ea9076ee4baf8138fdc25ce02522, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.702148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING py.warnings [None req-b9454177-608b-4e80-8e71-0c6542fd651a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:36:24.702148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: warnings.warn(msg) May 25 07:36:24.702148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: May 25 07:36:24.702148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9454177-608b-4e80-8e71-0c6542fd651a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.740141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 794/1576] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:24 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:24.740141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68180a7-53ea-4b74-8337-9b86360a69b4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.798295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68180a7-53ea-4b74-8337-9b86360a69b4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.803140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 783/1577] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:24 2022] PUT /identity/v3/projects/2d8e35800ce043acbcb027ce406ed2e7/users/0487ea9076ee4baf8138fdc25ce02522/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:24.803140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9454177-608b-4e80-8e71-0c6542fd651a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.811041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:24.860398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5ddbf-5336-466b-8d29-253f372ae847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.861104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5ddbf-5336-466b-8d29-253f372ae847 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.861389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5ddbf-5336-466b-8d29-253f372ae847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.861665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a5ddbf-5336-466b-8d29-253f372ae847 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.861757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9454177-608b-4e80-8e71-0c6542fd651a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.862394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5ddbf-5336-466b-8d29-253f372ae847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.864020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a5ddbf-5336-466b-8d29-253f372ae847 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.867631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99454c87-5631-43bc-821f-90db550f23b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.870422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99454c87-5631-43bc-821f-90db550f23b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.870422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99454c87-5631-43bc-821f-90db550f23b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.870422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99454c87-5631-43bc-821f-90db550f23b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.870422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99454c87-5631-43bc-821f-90db550f23b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.871555 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99454c87-5631-43bc-821f-90db550f23b3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:24.873932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 795/1578] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:24 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:24.875466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5ddbf-5336-466b-8d29-253f372ae847 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:24.884957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a5ddbf-5336-466b-8d29-253f372ae847 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:24.890833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04142e6-ad5f-4489-8241-366947f54fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:24.891505 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04142e6-ad5f-4489-8241-366947f54fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:24.891788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04142e6-ad5f-4489-8241-366947f54fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:24.892063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04142e6-ad5f-4489-8241-366947f54fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:24.892777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04142e6-ad5f-4489-8241-366947f54fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:24.894739 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04142e6-ad5f-4489-8241-366947f54fb7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.003798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 784/1579] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:24 2022] POST /identity/v3/projects => generated 375 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:25.003798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99454c87-5631-43bc-821f-90db550f23b3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.055583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 796/1580] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:24 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:25.055583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04142e6-ad5f-4489-8241-366947f54fb7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.062609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99454c87-5631-43bc-821f-90db550f23b3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.117035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04142e6-ad5f-4489-8241-366947f54fb7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.119004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980263f-9854-4e2e-a182-4e3f418a6fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.119713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980263f-9854-4e2e-a182-4e3f418a6fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.119999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980263f-9854-4e2e-a182-4e3f418a6fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.120282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6980263f-9854-4e2e-a182-4e3f418a6fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.121006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980263f-9854-4e2e-a182-4e3f418a6fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.121940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6946aca-a708-47d3-bc95-c90c4ee37128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.122630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6946aca-a708-47d3-bc95-c90c4ee37128 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.122918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6946aca-a708-47d3-bc95-c90c4ee37128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.123037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6980263f-9854-4e2e-a182-4e3f418a6fd8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.123189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6946aca-a708-47d3-bc95-c90c4ee37128 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.123919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6946aca-a708-47d3-bc95-c90c4ee37128 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.127038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6946aca-a708-47d3-bc95-c90c4ee37128 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.132542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:25.139051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 797/1581] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.140408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6946aca-a708-47d3-bc95-c90c4ee37128 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.152181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6946aca-a708-47d3-bc95-c90c4ee37128 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.157062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c1088-34b4-42a7-912d-a5ff58cc3f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.157758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1088-34b4-42a7-912d-a5ff58cc3f02 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.158039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1088-34b4-42a7-912d-a5ff58cc3f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.158315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665c1088-34b4-42a7-912d-a5ff58cc3f02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.159024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c1088-34b4-42a7-912d-a5ff58cc3f02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.161078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665c1088-34b4-42a7-912d-a5ff58cc3f02 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.172112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 798/1582] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.173063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c1088-34b4-42a7-912d-a5ff58cc3f02 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.182416 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665c1088-34b4-42a7-912d-a5ff58cc3f02 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.187818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a7149b-78e8-44bb-800c-71553e0dd137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.188675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7149b-78e8-44bb-800c-71553e0dd137 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.188955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7149b-78e8-44bb-800c-71553e0dd137 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.189223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a7149b-78e8-44bb-800c-71553e0dd137 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.189885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7149b-78e8-44bb-800c-71553e0dd137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.192026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a7149b-78e8-44bb-800c-71553e0dd137 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.289794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 799/1583] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:25 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:25.290528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 785/1584] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:25 2022] POST /identity/v3/users => generated 282 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:25.291002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d1198-657b-4b08-90a2-37e263d677b9 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.291166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980263f-9854-4e2e-a182-4e3f418a6fd8 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.291419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d1198-657b-4b08-90a2-37e263d677b9 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.291718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d1198-657b-4b08-90a2-37e263d677b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.303742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6980263f-9854-4e2e-a182-4e3f418a6fd8 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.308432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739affe-ddda-4a9f-ab3a-c23c22d454f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.309350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739affe-ddda-4a9f-ab3a-c23c22d454f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.309637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739affe-ddda-4a9f-ab3a-c23c22d454f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.309922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739affe-ddda-4a9f-ab3a-c23c22d454f6 admin admin] PATH_INFO: `/v3/projects/39578c81fb5b4b208039318217fdb3a2/users/107da1af788341e4817a7038495f050c/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.310790 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-706d1198-657b-4b08-90a2-37e263d677b9 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:25.312703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-706d1198-657b-4b08-90a2-37e263d677b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:25.320304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 800/1585] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:25.321092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d1198-657b-4b08-90a2-37e263d677b9 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.330174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739affe-ddda-4a9f-ab3a-c23c22d454f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39578c81fb5b4b208039318217fdb3a2, user_id=107da1af788341e4817a7038495f050c, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.330522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d1198-657b-4b08-90a2-37e263d677b9 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.333196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739affe-ddda-4a9f-ab3a-c23c22d454f6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.335247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455a61-8a87-402c-acc1-fdb387ec5c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.335907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455a61-8a87-402c-acc1-fdb387ec5c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.336582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455a61-8a87-402c-acc1-fdb387ec5c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.336582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52455a61-8a87-402c-acc1-fdb387ec5c18 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.337159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455a61-8a87-402c-acc1-fdb387ec5c18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.339072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52455a61-8a87-402c-acc1-fdb387ec5c18 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.427439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 786/1586] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:25 2022] PUT /identity/v3/projects/39578c81fb5b4b208039318217fdb3a2/users/107da1af788341e4817a7038495f050c/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:25.428234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739affe-ddda-4a9f-ab3a-c23c22d454f6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.439252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 801/1587] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:25 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:25.440350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455a61-8a87-402c-acc1-fdb387ec5c18 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.450678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52455a61-8a87-402c-acc1-fdb387ec5c18 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.480125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:25.492139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739affe-ddda-4a9f-ab3a-c23c22d454f6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.497374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468f834-c29a-45fc-8027-2688a87c1fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.498201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468f834-c29a-45fc-8027-2688a87c1fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.498584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468f834-c29a-45fc-8027-2688a87c1fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.499266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2468f834-c29a-45fc-8027-2688a87c1fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.501268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468f834-c29a-45fc-8027-2688a87c1fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.503719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2468f834-c29a-45fc-8027-2688a87c1fa3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.509561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ff385-8eca-4e6e-82f9-da6ac64cda27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.510239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ff385-8eca-4e6e-82f9-da6ac64cda27 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.510522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ff385-8eca-4e6e-82f9-da6ac64cda27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.510803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ff385-8eca-4e6e-82f9-da6ac64cda27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.511527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ff385-8eca-4e6e-82f9-da6ac64cda27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.513199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ff385-8eca-4e6e-82f9-da6ac64cda27 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.523092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 802/1588] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.529806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ff385-8eca-4e6e-82f9-da6ac64cda27 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.534061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ff385-8eca-4e6e-82f9-da6ac64cda27 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.538643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eff0a-b73b-4c56-9395-0631e52f0a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.539313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eff0a-b73b-4c56-9395-0631e52f0a1a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.539599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eff0a-b73b-4c56-9395-0631e52f0a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.539920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218eff0a-b73b-4c56-9395-0631e52f0a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.540609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eff0a-b73b-4c56-9395-0631e52f0a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.542171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218eff0a-b73b-4c56-9395-0631e52f0a1a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.555388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 803/1589] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.555388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eff0a-b73b-4c56-9395-0631e52f0a1a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.563193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218eff0a-b73b-4c56-9395-0631e52f0a1a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.567732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940107f-b0d7-47a4-bad9-ea2ce76c11a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.568381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940107f-b0d7-47a4-bad9-ea2ce76c11a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.568693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940107f-b0d7-47a4-bad9-ea2ce76c11a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.568970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940107f-b0d7-47a4-bad9-ea2ce76c11a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.569667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940107f-b0d7-47a4-bad9-ea2ce76c11a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.571226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940107f-b0d7-47a4-bad9-ea2ce76c11a3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.581642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 804/1590] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.582487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940107f-b0d7-47a4-bad9-ea2ce76c11a3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.595458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940107f-b0d7-47a4-bad9-ea2ce76c11a3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.600033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff0e82-5763-4be9-987d-84aa669a6e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.600729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff0e82-5763-4be9-987d-84aa669a6e10 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.601014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff0e82-5763-4be9-987d-84aa669a6e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.601292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff0e82-5763-4be9-987d-84aa669a6e10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.602309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff0e82-5763-4be9-987d-84aa669a6e10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.603907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff0e82-5763-4be9-987d-84aa669a6e10 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.610820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 787/1591] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:25 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:25.611663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468f834-c29a-45fc-8027-2688a87c1fa3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.614538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 805/1592] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.615789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0118-a586-418e-8503-31fb6d365342 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.616077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0118-a586-418e-8503-31fb6d365342 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.616355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9e0118-a586-418e-8503-31fb6d365342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.633770 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6e9e0118-a586-418e-8503-31fb6d365342 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:25.634972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6e9e0118-a586-418e-8503-31fb6d365342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:25.642966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 806/1593] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:25.643758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0118-a586-418e-8503-31fb6d365342 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.653376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9e0118-a586-418e-8503-31fb6d365342 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.659509 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e81b9d-4690-4195-b42b-86a80c8506c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.660497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e81b9d-4690-4195-b42b-86a80c8506c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.660789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e81b9d-4690-4195-b42b-86a80c8506c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.661087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e81b9d-4690-4195-b42b-86a80c8506c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.661783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e81b9d-4690-4195-b42b-86a80c8506c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.663427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e81b9d-4690-4195-b42b-86a80c8506c9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.673078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2468f834-c29a-45fc-8027-2688a87c1fa3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.674794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 807/1594] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.675543 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e81b9d-4690-4195-b42b-86a80c8506c9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.676721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9d912-9e70-4780-ae9a-93686de1dbe8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.681341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9d912-9e70-4780-ae9a-93686de1dbe8 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.681341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9d912-9e70-4780-ae9a-93686de1dbe8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.681341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da9d912-9e70-4780-ae9a-93686de1dbe8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.685044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e81b9d-4690-4195-b42b-86a80c8506c9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.687201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9d912-9e70-4780-ae9a-93686de1dbe8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.688726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da9d912-9e70-4780-ae9a-93686de1dbe8 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.690102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14683133-d4f5-4ef8-94b7-a24ea79a9bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.691080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14683133-d4f5-4ef8-94b7-a24ea79a9bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.691428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14683133-d4f5-4ef8-94b7-a24ea79a9bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.691768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14683133-d4f5-4ef8-94b7-a24ea79a9bb8 admin admin] PATH_INFO: `/v3/projects/7b680101e6694c3a9d345c92ee378101/users/fe098a4d40404eb89bd1d7b552c68654/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.699349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 788/1595] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:25.705476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9d912-9e70-4780-ae9a-93686de1dbe8 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.706679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14683133-d4f5-4ef8-94b7-a24ea79a9bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b680101e6694c3a9d345c92ee378101, user_id=fe098a4d40404eb89bd1d7b552c68654, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.709440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14683133-d4f5-4ef8-94b7-a24ea79a9bb8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.715271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da9d912-9e70-4780-ae9a-93686de1dbe8 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.720532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877153d1-ec48-4277-949e-9d5225a2318f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.721435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877153d1-ec48-4277-949e-9d5225a2318f admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.721777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877153d1-ec48-4277-949e-9d5225a2318f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.722056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877153d1-ec48-4277-949e-9d5225a2318f admin admin] PATH_INFO: `/v3/projects/d4719a4804e24f27b9427e58c5cbe13b/users/f90f0f6afda54e80bc319dc5bdb80ea6/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.737865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877153d1-ec48-4277-949e-9d5225a2318f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4719a4804e24f27b9427e58c5cbe13b, user_id=f90f0f6afda54e80bc319dc5bdb80ea6, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.740553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877153d1-ec48-4277-949e-9d5225a2318f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.827216 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 808/1596] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:25 2022] PUT /identity/v3/projects/7b680101e6694c3a9d345c92ee378101/users/fe098a4d40404eb89bd1d7b552c68654/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:25.828170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14683133-d4f5-4ef8-94b7-a24ea79a9bb8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.868795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 789/1597] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:25 2022] PUT /identity/v3/projects/d4719a4804e24f27b9427e58c5cbe13b/users/f90f0f6afda54e80bc319dc5bdb80ea6/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:25.868795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877153d1-ec48-4277-949e-9d5225a2318f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.898172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14683133-d4f5-4ef8-94b7-a24ea79a9bb8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.920067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:25.945294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877153d1-ec48-4277-949e-9d5225a2318f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.951280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839926c-ff32-49d1-af7a-136edf4b8c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.951977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839926c-ff32-49d1-af7a-136edf4b8c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.952997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839926c-ff32-49d1-af7a-136edf4b8c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.953257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a839926c-ff32-49d1-af7a-136edf4b8c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.954125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839926c-ff32-49d1-af7a-136edf4b8c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.955822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a839926c-ff32-49d1-af7a-136edf4b8c36 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.961560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afbefc-f348-4639-83cb-d89f5f120da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.962238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afbefc-f348-4639-83cb-d89f5f120da9 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.962522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afbefc-f348-4639-83cb-d89f5f120da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.962799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34afbefc-f348-4639-83cb-d89f5f120da9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.963579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afbefc-f348-4639-83cb-d89f5f120da9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.965214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34afbefc-f348-4639-83cb-d89f5f120da9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.969398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 790/1598] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.969398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839926c-ff32-49d1-af7a-136edf4b8c36 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.970751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:25.976088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 809/1599] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.976714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a839926c-ff32-49d1-af7a-136edf4b8c36 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:25.977187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afbefc-f348-4639-83cb-d89f5f120da9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:25.981851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33dd5d-bbd2-408c-a9f3-7d37fe4f0daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:25.982565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33dd5d-bbd2-408c-a9f3-7d37fe4f0daf admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:25.982976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33dd5d-bbd2-408c-a9f3-7d37fe4f0daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:25.983279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e33dd5d-bbd2-408c-a9f3-7d37fe4f0daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:25.984579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33dd5d-bbd2-408c-a9f3-7d37fe4f0daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:25.986210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e33dd5d-bbd2-408c-a9f3-7d37fe4f0daf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:25.996520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 791/1600] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:25.997098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33dd5d-bbd2-408c-a9f3-7d37fe4f0daf admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:26.007296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e33dd5d-bbd2-408c-a9f3-7d37fe4f0daf admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:26.012686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057bca5-74a6-49db-bf8c-d4b07f23929a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:26.013352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057bca5-74a6-49db-bf8c-d4b07f23929a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.014443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057bca5-74a6-49db-bf8c-d4b07f23929a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.014443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057bca5-74a6-49db-bf8c-d4b07f23929a admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.021548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057bca5-74a6-49db-bf8c-d4b07f23929a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:26.021548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0057bca5-74a6-49db-bf8c-d4b07f23929a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:26.027802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 792/1601] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:26.029104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa706800-ff3b-48aa-bc6f-43c741b8ec74 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.029389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa706800-ff3b-48aa-bc6f-43c741b8ec74 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.029666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa706800-ff3b-48aa-bc6f-43c741b8ec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.033979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34afbefc-f348-4639-83cb-d89f5f120da9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:26.037923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cf10c-54d8-4e10-b913-bfa16c0aed1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:26.038469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf10c-54d8-4e10-b913-bfa16c0aed1b service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.038749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf10c-54d8-4e10-b913-bfa16c0aed1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.039022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cf10c-54d8-4e10-b913-bfa16c0aed1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.050094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cf10c-54d8-4e10-b913-bfa16c0aed1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:26.051268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219cf10c-54d8-4e10-b913-bfa16c0aed1b service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:26.058357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-aa706800-ff3b-48aa-bc6f-43c741b8ec74 None None] MFA Rules not processed for user `fe098a4d40404eb89bd1d7b552c68654`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:26.059599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-aa706800-ff3b-48aa-bc6f-43c741b8ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:26.062930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 810/1602] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:26.064237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d922eb-e900-4a4a-b0cd-369954786ee5 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.067495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d922eb-e900-4a4a-b0cd-369954786ee5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.067495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d922eb-e900-4a4a-b0cd-369954786ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.086236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a6d922eb-e900-4a4a-b0cd-369954786ee5 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:26.087493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a6d922eb-e900-4a4a-b0cd-369954786ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:26.096574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 811/1603] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:26.097505 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d922eb-e900-4a4a-b0cd-369954786ee5 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:26.107540 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d922eb-e900-4a4a-b0cd-369954786ee5 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:26.117708 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586c5a-69f2-4fee-853f-a7b6f5cefb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:26.118387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586c5a-69f2-4fee-853f-a7b6f5cefb7f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.118806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586c5a-69f2-4fee-853f-a7b6f5cefb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.119088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586c5a-69f2-4fee-853f-a7b6f5cefb7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.119868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a586c5a-69f2-4fee-853f-a7b6f5cefb7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:26.121681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a586c5a-69f2-4fee-853f-a7b6f5cefb7f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:26.142179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 812/1604] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:26.142179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586c5a-69f2-4fee-853f-a7b6f5cefb7f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:26.142457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 793/1605] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:26.142457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa706800-ff3b-48aa-bc6f-43c741b8ec74 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:26.154090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586c5a-69f2-4fee-853f-a7b6f5cefb7f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:26.159641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa706800-ff3b-48aa-bc6f-43c741b8ec74 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:26.161701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd681ffd-8298-4fba-956c-10d7a8b1d68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:26.162725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd681ffd-8298-4fba-956c-10d7a8b1d68b admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.163146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd681ffd-8298-4fba-956c-10d7a8b1d68b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.163439 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd681ffd-8298-4fba-956c-10d7a8b1d68b admin admin] PATH_INFO: `/v3/projects/c4406d5d0e2347f1b96c34496f5ba5ae/users/18eb8b615526451498d3adc382d5a410/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.167844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61780437-d834-4f01-91fb-48e4562966d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:26.168948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780437-d834-4f01-91fb-48e4562966d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.169261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780437-d834-4f01-91fb-48e4562966d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.172022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61780437-d834-4f01-91fb-48e4562966d0 admin admin] PATH_INFO: `/v3/projects/d5237b3b97634d7ea235040957b45aa5/users/2cf9329954c649f788aeba72ef3b011c/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.182509 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd681ffd-8298-4fba-956c-10d7a8b1d68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4406d5d0e2347f1b96c34496f5ba5ae, user_id=18eb8b615526451498d3adc382d5a410, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:26.186612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd681ffd-8298-4fba-956c-10d7a8b1d68b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:26.189554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61780437-d834-4f01-91fb-48e4562966d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5237b3b97634d7ea235040957b45aa5, user_id=2cf9329954c649f788aeba72ef3b011c, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:26.192410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61780437-d834-4f01-91fb-48e4562966d0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:26.330225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 813/1606] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:26 2022] PUT /identity/v3/projects/c4406d5d0e2347f1b96c34496f5ba5ae/users/18eb8b615526451498d3adc382d5a410/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:26.330225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd681ffd-8298-4fba-956c-10d7a8b1d68b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:26.334235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 794/1607] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:26 2022] PUT /identity/v3/projects/d5237b3b97634d7ea235040957b45aa5/users/2cf9329954c649f788aeba72ef3b011c/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:26.335388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61780437-d834-4f01-91fb-48e4562966d0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:26.398111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61780437-d834-4f01-91fb-48e4562966d0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:26.399828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd681ffd-8298-4fba-956c-10d7a8b1d68b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:26.401861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa0fde-f1c0-4bb7-a125-bb9616328a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:26.402783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0fde-f1c0-4bb7-a125-bb9616328a66 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.402968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0fde-f1c0-4bb7-a125-bb9616328a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.403240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa0fde-f1c0-4bb7-a125-bb9616328a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.443724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:26.479049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2c013-d046-4e33-b922-606b31707c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:26.483915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2c013-d046-4e33-b922-606b31707c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.483915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2c013-d046-4e33-b922-606b31707c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.483915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2c013-d046-4e33-b922-606b31707c20 admin admin] PATH_INFO: `/v3/projects/294afe2c36184564a80fb6bef7b32359/users/28d83ef95cda448dbd72acbd13a5f008/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.494718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:26.499084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2c013-d046-4e33-b922-606b31707c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=294afe2c36184564a80fb6bef7b32359, user_id=28d83ef95cda448dbd72acbd13a5f008, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:26.502667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2c013-d046-4e33-b922-606b31707c20 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:26.508550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa0fde-f1c0-4bb7-a125-bb9616328a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:26.510094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa0fde-f1c0-4bb7-a125-bb9616328a66 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:26.519919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 795/1608] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:26.529863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa0fde-f1c0-4bb7-a125-bb9616328a66 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:26.530226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa0fde-f1c0-4bb7-a125-bb9616328a66 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:26.535893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b6f1a9-70b4-4724-ac43-f21a3c6d8331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:26.536814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6f1a9-70b4-4724-ac43-f21a3c6d8331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.537093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6f1a9-70b4-4724-ac43-f21a3c6d8331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.537383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6f1a9-70b4-4724-ac43-f21a3c6d8331 admin admin] PATH_INFO: `/v3/projects/b8c00a254f984ace8b02d68d030d4155/users/cfec9a89ff494ab3b7718ddf035e811f/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.553077 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6f1a9-70b4-4724-ac43-f21a3c6d8331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8c00a254f984ace8b02d68d030d4155, user_id=cfec9a89ff494ab3b7718ddf035e811f, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:26.564299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b6f1a9-70b4-4724-ac43-f21a3c6d8331 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:26.597725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 814/1609] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:26 2022] PUT /identity/v3/projects/294afe2c36184564a80fb6bef7b32359/users/28d83ef95cda448dbd72acbd13a5f008/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:26.599085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b774ea-0982-49a4-b661-b75a3001de29 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.599468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b774ea-0982-49a4-b661-b75a3001de29 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.599805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b774ea-0982-49a4-b661-b75a3001de29 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.605994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 815/1610] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 07:36:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:36:26.607599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcfaab-29a7-41ee-baea-8a021adb3071 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.607974 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcfaab-29a7-41ee-baea-8a021adb3071 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.608438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fcfaab-29a7-41ee-baea-8a021adb3071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.627580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-09fcfaab-29a7-41ee-baea-8a021adb3071 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:26.629397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-09fcfaab-29a7-41ee-baea-8a021adb3071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:26.696922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 796/1611] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:26 2022] PUT /identity/v3/projects/b8c00a254f984ace8b02d68d030d4155/users/cfec9a89ff494ab3b7718ddf035e811f/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:26.696922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c65819-79b3-430b-a338-cafe79953930 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.696922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c65819-79b3-430b-a338-cafe79953930 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.696922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c65819-79b3-430b-a338-cafe79953930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.710883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 816/1612] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:26.712669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6e742-0871-4f66-9c3c-11cd030789fa None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.712960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6e742-0871-4f66-9c3c-11cd030789fa None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.713237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6e742-0871-4f66-9c3c-11cd030789fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.733000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-70f6e742-0871-4f66-9c3c-11cd030789fa None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:26.735344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-70f6e742-0871-4f66-9c3c-11cd030789fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:26.735557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-87c65819-79b3-430b-a338-cafe79953930 None None] MFA Rules not processed for user `2cf9329954c649f788aeba72ef3b011c`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:26.736911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-87c65819-79b3-430b-a338-cafe79953930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:26.802116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 817/1613] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:26.807526 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc9f5-7e72-4cf6-ae45-e27bfe5aa652 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.807922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc9f5-7e72-4cf6-ae45-e27bfe5aa652 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.808934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0adc9f5-7e72-4cf6-ae45-e27bfe5aa652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.811906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 797/1614] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:26 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:26.813952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d64cb-200a-4973-b88b-b565d5bf7d7e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:26.814261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d64cb-200a-4973-b88b-b565d5bf7d7e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:26.814649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d64cb-200a-4973-b88b-b565d5bf7d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:26.837818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f0adc9f5-7e72-4cf6-ae45-e27bfe5aa652 None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:26.839269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f0adc9f5-7e72-4cf6-ae45-e27bfe5aa652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:26.845187 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2c0d64cb-200a-4973-b88b-b565d5bf7d7e None None] MFA Rules not processed for user `cfec9a89ff494ab3b7718ddf035e811f`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:26.852396 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2c0d64cb-200a-4973-b88b-b565d5bf7d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:26.943464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 818/1615] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 07:36:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:26.945446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc9f5-7e72-4cf6-ae45-e27bfe5aa652 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:26.955069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 798/1616] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:26.955983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d64cb-200a-4973-b88b-b565d5bf7d7e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:26.987506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:26.992138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:27.023399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0adc9f5-7e72-4cf6-ae45-e27bfe5aa652 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.027571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c3fb8-0c97-42be-907b-71fadd3959b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.028345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c3fb8-0c97-42be-907b-71fadd3959b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.028747 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c3fb8-0c97-42be-907b-71fadd3959b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.029386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c3fb8-0c97-42be-907b-71fadd3959b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.040190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c3fb8-0c97-42be-907b-71fadd3959b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.042042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c3fb8-0c97-42be-907b-71fadd3959b3 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.042880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d64cb-200a-4973-b88b-b565d5bf7d7e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.047536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee93f-3c82-4243-b52f-88ee81f05488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.048327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee93f-3c82-4243-b52f-88ee81f05488 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.048691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee93f-3c82-4243-b52f-88ee81f05488 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.049294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894ee93f-3c82-4243-b52f-88ee81f05488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.058067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 819/1617] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:27.058800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c3fb8-0c97-42be-907b-71fadd3959b3 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.061182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee93f-3c82-4243-b52f-88ee81f05488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.063035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894ee93f-3c82-4243-b52f-88ee81f05488 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.072758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c3fb8-0c97-42be-907b-71fadd3959b3 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.076227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 799/1618] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:27.077113 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee93f-3c82-4243-b52f-88ee81f05488 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.078856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a1ba0-6373-4b03-aa51-ff21ae8cbad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.079662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a1ba0-6373-4b03-aa51-ff21ae8cbad6 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.080098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a1ba0-6373-4b03-aa51-ff21ae8cbad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.080603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a1ba0-6373-4b03-aa51-ff21ae8cbad6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.081384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a1ba0-6373-4b03-aa51-ff21ae8cbad6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.083852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a1ba0-6373-4b03-aa51-ff21ae8cbad6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.093677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894ee93f-3c82-4243-b52f-88ee81f05488 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.103028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd98ed1-4462-4da3-8046-b7fc784d5764 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.103887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd98ed1-4462-4da3-8046-b7fc784d5764 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.104182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd98ed1-4462-4da3-8046-b7fc784d5764 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.104521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd98ed1-4462-4da3-8046-b7fc784d5764 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.165911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd98ed1-4462-4da3-8046-b7fc784d5764 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.167503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd98ed1-4462-4da3-8046-b7fc784d5764 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.176876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 800/1619] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:27.177825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd98ed1-4462-4da3-8046-b7fc784d5764 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.188702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd98ed1-4462-4da3-8046-b7fc784d5764 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.204546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e0aa8-3ec1-4305-9323-7ea30b03cb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.205394 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0aa8-3ec1-4305-9323-7ea30b03cb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.205685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0aa8-3ec1-4305-9323-7ea30b03cb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.205991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e0aa8-3ec1-4305-9323-7ea30b03cb47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.206859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0aa8-3ec1-4305-9323-7ea30b03cb47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.208914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e0aa8-3ec1-4305-9323-7ea30b03cb47 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.232290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 820/1620] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:27 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:27.234272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a1ba0-6373-4b03-aa51-ff21ae8cbad6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.319222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a1ba0-6373-4b03-aa51-ff21ae8cbad6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.324086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eabc6-54a2-48ba-af9f-d541fbf8203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.324788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eabc6-54a2-48ba-af9f-d541fbf8203e admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.325068 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eabc6-54a2-48ba-af9f-d541fbf8203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.325337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575eabc6-54a2-48ba-af9f-d541fbf8203e admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.326022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eabc6-54a2-48ba-af9f-d541fbf8203e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.328088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575eabc6-54a2-48ba-af9f-d541fbf8203e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.400233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 801/1621] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:27 2022] POST /identity/v3/projects => generated 383 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:27.400994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e0aa8-3ec1-4305-9323-7ea30b03cb47 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.430048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 821/1622] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:27 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:27.434323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eabc6-54a2-48ba-af9f-d541fbf8203e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.460827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575eabc6-54a2-48ba-af9f-d541fbf8203e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.512094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e0aa8-3ec1-4305-9323-7ea30b03cb47 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.519178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a752d5-db7d-4472-bc77-5790c58adfa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.520134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a752d5-db7d-4472-bc77-5790c58adfa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.520571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a752d5-db7d-4472-bc77-5790c58adfa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.520928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a752d5-db7d-4472-bc77-5790c58adfa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.521761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a752d5-db7d-4472-bc77-5790c58adfa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.524227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a752d5-db7d-4472-bc77-5790c58adfa3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.551846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4fc77-3844-43c7-9545-5d61d46f9e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.562168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4fc77-3844-43c7-9545-5d61d46f9e0d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.562168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4fc77-3844-43c7-9545-5d61d46f9e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.562168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4fc77-3844-43c7-9545-5d61d46f9e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.562168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4fc77-3844-43c7-9545-5d61d46f9e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.562168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4fc77-3844-43c7-9545-5d61d46f9e0d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.579249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 822/1623] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:36:27.581296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458097c-6d13-48d4-976f-d16c4bbd363a None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.581743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458097c-6d13-48d4-976f-d16c4bbd363a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.582227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7458097c-6d13-48d4-976f-d16c4bbd363a None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.583803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 823/1624] 10.222.0.24 () {54 vars in 912 bytes} [Wed May 25 07:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:36:27.585432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458097c-6d13-48d4-976f-d16c4bbd363a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.604228 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7458097c-6d13-48d4-976f-d16c4bbd363a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.611303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb0833-2d2d-494d-aa13-eaf558935f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.612648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb0833-2d2d-494d-aa13-eaf558935f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.612809 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 802/1625] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:27 2022] POST /identity/v3/users => generated 298 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:27.613240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb0833-2d2d-494d-aa13-eaf558935f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.613775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cb0833-2d2d-494d-aa13-eaf558935f0b admin admin] PATH_INFO: `/v3/projects/58eebff618e045cc86d90cdf1f0553e1/users/75508971115340b7a0a3debd9b18f4e4/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.614497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716185a-f9a6-4e1a-9f56-59d32f6d817a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.615665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716185a-f9a6-4e1a-9f56-59d32f6d817a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.616281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716185a-f9a6-4e1a-9f56-59d32f6d817a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.635209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb0833-2d2d-494d-aa13-eaf558935f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58eebff618e045cc86d90cdf1f0553e1, user_id=75508971115340b7a0a3debd9b18f4e4, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.639982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cb0833-2d2d-494d-aa13-eaf558935f0b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.660635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c716185a-f9a6-4e1a-9f56-59d32f6d817a None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:27.661922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c716185a-f9a6-4e1a-9f56-59d32f6d817a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:27.740971 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 824/1626] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:27 2022] PUT /identity/v3/projects/58eebff618e045cc86d90cdf1f0553e1/users/75508971115340b7a0a3debd9b18f4e4/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:27.741975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb0833-2d2d-494d-aa13-eaf558935f0b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.753417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:27.767755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 803/1627] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:36:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:27.770092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716185a-f9a6-4e1a-9f56-59d32f6d817a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.783846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716185a-f9a6-4e1a-9f56-59d32f6d817a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.852235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:27.878345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207bb28-24cd-4433-b581-68ee570f792b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.879669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207bb28-24cd-4433-b581-68ee570f792b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.879960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207bb28-24cd-4433-b581-68ee570f792b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.883204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207bb28-24cd-4433-b581-68ee570f792b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.892756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207bb28-24cd-4433-b581-68ee570f792b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.892756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4207bb28-24cd-4433-b581-68ee570f792b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.892927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cb0833-2d2d-494d-aa13-eaf558935f0b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.897189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18247c47-1a2f-46d8-8a7a-e2353aa3a471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.897874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18247c47-1a2f-46d8-8a7a-e2353aa3a471 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.898156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18247c47-1a2f-46d8-8a7a-e2353aa3a471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.898428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18247c47-1a2f-46d8-8a7a-e2353aa3a471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.900004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18247c47-1a2f-46d8-8a7a-e2353aa3a471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.901806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18247c47-1a2f-46d8-8a7a-e2353aa3a471 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.912449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 804/1628] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:27.917032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207bb28-24cd-4433-b581-68ee570f792b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.931441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 825/1629] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:27.932507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18247c47-1a2f-46d8-8a7a-e2353aa3a471 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:27.958420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18247c47-1a2f-46d8-8a7a-e2353aa3a471 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:27.972003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c95b-affb-4667-abbb-f08a3cf18745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:27.972960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c95b-affb-4667-abbb-f08a3cf18745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:27.973295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c95b-affb-4667-abbb-f08a3cf18745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:27.973569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a734c95b-affb-4667-abbb-f08a3cf18745 admin admin] PATH_INFO: `/v3/projects/58eebff618e045cc86d90cdf1f0553e1/users/75508971115340b7a0a3debd9b18f4e4/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:27.975778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734c95b-affb-4667-abbb-f08a3cf18745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58eebff618e045cc86d90cdf1f0553e1, user_id=75508971115340b7a0a3debd9b18f4e4, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:27.979193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a734c95b-affb-4667-abbb-f08a3cf18745 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:27.991062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 826/1630] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:27 2022] PUT /identity/v3/projects/58eebff618e045cc86d90cdf1f0553e1/users/75508971115340b7a0a3debd9b18f4e4/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:27.992208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c95b-affb-4667-abbb-f08a3cf18745 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:28.033420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207bb28-24cd-4433-b581-68ee570f792b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:28.102923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a734c95b-affb-4667-abbb-f08a3cf18745 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:28.111305 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a3e6f-bee8-44a0-8b7b-e6ba0399507d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:28.112313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a3e6f-bee8-44a0-8b7b-e6ba0399507d admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.112715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a3e6f-bee8-44a0-8b7b-e6ba0399507d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.112998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a3e6f-bee8-44a0-8b7b-e6ba0399507d admin admin] PATH_INFO: `/v3/projects/4de53696f22f44d9ba77f5fad9f7f66e/users/f301679147334a31b427caf28e2648a5/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.131552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a3e6f-bee8-44a0-8b7b-e6ba0399507d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de53696f22f44d9ba77f5fad9f7f66e, user_id=f301679147334a31b427caf28e2648a5, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:28.135886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a3e6f-bee8-44a0-8b7b-e6ba0399507d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:28.157918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad858b-c094-418e-b6fc-282e24b8f426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:28.158877 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad858b-c094-418e-b6fc-282e24b8f426 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.159343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad858b-c094-418e-b6fc-282e24b8f426 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.159828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad858b-c094-418e-b6fc-282e24b8f426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.249698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad858b-c094-418e-b6fc-282e24b8f426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:28.251155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ad858b-c094-418e-b6fc-282e24b8f426 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:28.262643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 805/1631] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:28.266905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c7335-a754-43d3-a74b-28002d54ae2b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.267199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c7335-a754-43d3-a74b-28002d54ae2b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.267756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2c7335-a754-43d3-a74b-28002d54ae2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.275621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 827/1632] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:27 2022] PUT /identity/v3/projects/4de53696f22f44d9ba77f5fad9f7f66e/users/f301679147334a31b427caf28e2648a5/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:28.276887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63a841-503a-4573-9da1-30f06bb7af47 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.277294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63a841-503a-4573-9da1-30f06bb7af47 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.277458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63a841-503a-4573-9da1-30f06bb7af47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.317285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4c63a841-503a-4573-9da1-30f06bb7af47 None None] MFA Rules not processed for user `107da1af788341e4817a7038495f050c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:28.318476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7e2c7335-a754-43d3-a74b-28002d54ae2b None None] MFA Rules not processed for user `75508971115340b7a0a3debd9b18f4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:28.318632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4c63a841-503a-4573-9da1-30f06bb7af47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:28.319686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7e2c7335-a754-43d3-a74b-28002d54ae2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:28.449302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 828/1633] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:28.450352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63a841-503a-4573-9da1-30f06bb7af47 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:28.485742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 806/1634] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:28 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:28.494855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3362e-700e-4a96-91a5-9cc6e364dc81 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.495143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3362e-700e-4a96-91a5-9cc6e364dc81 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.495425 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3362e-700e-4a96-91a5-9cc6e364dc81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.535065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-bae3362e-700e-4a96-91a5-9cc6e364dc81 None None] MFA Rules not processed for user `107da1af788341e4817a7038495f050c`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:28.538120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bae3362e-700e-4a96-91a5-9cc6e364dc81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:28.559373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 807/1635] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:28.560324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3362e-700e-4a96-91a5-9cc6e364dc81 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:28.604282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63a841-503a-4573-9da1-30f06bb7af47 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:28.615630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a8a109-86c9-4567-bf13-066e3a79ff24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:28.616724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8a109-86c9-4567-bf13-066e3a79ff24 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.618048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8a109-86c9-4567-bf13-066e3a79ff24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.618524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a8a109-86c9-4567-bf13-066e3a79ff24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.620074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8a109-86c9-4567-bf13-066e3a79ff24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:28.624935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a8a109-86c9-4567-bf13-066e3a79ff24 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:28.656356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 829/1636] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:28 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:28.659000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce9734-d227-4e75-88f0-e884642ccc67 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.659621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce9734-d227-4e75-88f0-e884642ccc67 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.661768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ce9734-d227-4e75-88f0-e884642ccc67 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.664025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 830/1637] 10.222.0.24 () {54 vars in 961 bytes} [Wed May 25 07:36:28 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:36:28.665640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce9734-d227-4e75-88f0-e884642ccc67 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:28.697037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ce9734-d227-4e75-88f0-e884642ccc67 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:28.699160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3362e-700e-4a96-91a5-9cc6e364dc81 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:28.708466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e31190-1067-4852-aa1c-dabc9f1b7697 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:28.709176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e31190-1067-4852-aa1c-dabc9f1b7697 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.709354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd9ef7-62a9-497e-a0b5-a15010e3d0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:28.710578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9ef7-62a9-497e-a0b5-a15010e3d0ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.710922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9ef7-62a9-497e-a0b5-a15010e3d0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.711293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd9ef7-62a9-497e-a0b5-a15010e3d0ed admin admin] PATH_INFO: `/v3/projects/4de53696f22f44d9ba77f5fad9f7f66e/users/f301679147334a31b427caf28e2648a5/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.711412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e31190-1067-4852-aa1c-dabc9f1b7697 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.711680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e31190-1067-4852-aa1c-dabc9f1b7697 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.719029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd9ef7-62a9-497e-a0b5-a15010e3d0ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=4de53696f22f44d9ba77f5fad9f7f66e, user_id=f301679147334a31b427caf28e2648a5, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:28.725455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fd9ef7-62a9-497e-a0b5-a15010e3d0ed admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:28.731848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e31190-1067-4852-aa1c-dabc9f1b7697 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:28.736296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e31190-1067-4852-aa1c-dabc9f1b7697 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:28.753171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 831/1638] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:28 2022] PUT /identity/v3/projects/4de53696f22f44d9ba77f5fad9f7f66e/users/f301679147334a31b427caf28e2648a5/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:28.757805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc5ae5-174f-4b37-b23b-ab70374bc1a6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.758167 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc5ae5-174f-4b37-b23b-ab70374bc1a6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.758690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc5ae5-174f-4b37-b23b-ab70374bc1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.767313 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 808/1639] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:28 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:28.768987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5801a-a623-42c2-a412-5b74659178d5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.782428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5801a-a623-42c2-a412-5b74659178d5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.782428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee5801a-a623-42c2-a412-5b74659178d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:28.803070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5ee5801a-a623-42c2-a412-5b74659178d5 None None] MFA Rules not processed for user `f301679147334a31b427caf28e2648a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:28.804712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5ee5801a-a623-42c2-a412-5b74659178d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:28.809615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4afc5ae5-174f-4b37-b23b-ab70374bc1a6 None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:28.811155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4afc5ae5-174f-4b37-b23b-ab70374bc1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:28.816075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:28.934552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 832/1640] 10.222.0.24 () {58 vars in 1058 bytes} [Wed May 25 07:36:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:28.944275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc5ae5-174f-4b37-b23b-ab70374bc1a6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:28.963553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc5ae5-174f-4b37-b23b-ab70374bc1a6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:28.986425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534fc71-58d8-493f-9d37-5ad403814b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:28.987097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534fc71-58d8-493f-9d37-5ad403814b62 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:28.987379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534fc71-58d8-493f-9d37-5ad403814b62 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:28.987807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7534fc71-58d8-493f-9d37-5ad403814b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:29.118691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534fc71-58d8-493f-9d37-5ad403814b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:29.120328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7534fc71-58d8-493f-9d37-5ad403814b62 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:29.135808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 833/1641] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:29.168259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:29.195052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534fc71-58d8-493f-9d37-5ad403814b62 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:29.288291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7534fc71-58d8-493f-9d37-5ad403814b62 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:29.306015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a355af-06eb-4921-b760-8b68553b70e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:29.306015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a355af-06eb-4921-b760-8b68553b70e5 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:29.306015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a355af-06eb-4921-b760-8b68553b70e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:29.307842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a355af-06eb-4921-b760-8b68553b70e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:29.340025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 809/1642] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 568 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:29.458191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a355af-06eb-4921-b760-8b68553b70e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:29.461009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a355af-06eb-4921-b760-8b68553b70e5 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:29.473553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 834/1643] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:29.564504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e549f-2e21-4ad4-884d-907c3ad95168 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:29.565004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e549f-2e21-4ad4-884d-907c3ad95168 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:29.565171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e549f-2e21-4ad4-884d-907c3ad95168 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:29.569349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 810/1644] 10.222.0.24 () {54 vars in 912 bytes} [Wed May 25 07:36:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:36:29.584782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe683-92d8-45dc-9bb5-01cc5b752121 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:29.584782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe683-92d8-45dc-9bb5-01cc5b752121 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:29.584782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafe683-92d8-45dc-9bb5-01cc5b752121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:29.620632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9dafe683-92d8-45dc-9bb5-01cc5b752121 None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:29.622169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9dafe683-92d8-45dc-9bb5-01cc5b752121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:29.649473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 835/1645] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:36:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:29.664661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e549f-2e21-4ad4-884d-907c3ad95168 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:29.670646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-173e549f-2e21-4ad4-884d-907c3ad95168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:30.012972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e549f-2e21-4ad4-884d-907c3ad95168 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:30.012972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca7da5-097a-4a79-b475-7c9defbdff17 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451754f5553e4b9783b4e75f6d408ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:30.012972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca7da5-097a-4a79-b475-7c9defbdff17 service glance] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:30.012972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca7da5-097a-4a79-b475-7c9defbdff17 service glance] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:30.014199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca7da5-097a-4a79-b475-7c9defbdff17 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:30.014199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca7da5-097a-4a79-b475-7c9defbdff17 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:30.014199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca7da5-097a-4a79-b475-7c9defbdff17 service glance] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:30.014199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 811/1646] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:30.018149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafe683-92d8-45dc-9bb5-01cc5b752121 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:30.018149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafe683-92d8-45dc-9bb5-01cc5b752121 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:30.018149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aeb1a4-70a4-4bb3-a544-0fc479e39e23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:30.018149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb1a4-70a4-4bb3-a544-0fc479e39e23 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:30.019478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb1a4-70a4-4bb3-a544-0fc479e39e23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:30.019478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aeb1a4-70a4-4bb3-a544-0fc479e39e23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:30.032029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeb1a4-70a4-4bb3-a544-0fc479e39e23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:30.034094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aeb1a4-70a4-4bb3-a544-0fc479e39e23 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:30.056643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 836/1647] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:29 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:30.091511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca7da5-097a-4a79-b475-7c9defbdff17 service glance] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:30.230494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca7da5-097a-4a79-b475-7c9defbdff17 service glance] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:30.238628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:30.239571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:30.239854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:30.240131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] PATH_INFO: `/v3/users/cfec9a89ff494ab3b7718ddf035e811f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:30.241805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfec9a89ff494ab3b7718ddf035e811f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:30.242686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: WARNING py.warnings [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:36:30.242686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: warnings.warn(msg) May 25 07:36:30.242686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: May 25 07:36:30.249610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:30.433849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:30.562486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7dc2-7c6e-4544-8053-6be1705ffd28 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:30.562947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7dc2-7c6e-4544-8053-6be1705ffd28 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:30.563081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bb7dc2-7c6e-4544-8053-6be1705ffd28 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:30.569250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 837/1648] 10.222.0.24 () {54 vars in 912 bytes} [Wed May 25 07:36:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:36:30.573505 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4182c9-a967-49a2-bf5e-df1aaf67e649 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:30.573794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4182c9-a967-49a2-bf5e-df1aaf67e649 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:30.574067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4182c9-a967-49a2-bf5e-df1aaf67e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:30.639171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfec9a89ff494ab3b7718ddf035e811f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:30.670102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-af4182c9-a967-49a2-bf5e-df1aaf67e649 None None] MFA Rules not processed for user `a5f94913ac8a463db617fbe30df395b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:30.671591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-af4182c9-a967-49a2-bf5e-df1aaf67e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:30.673566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfec9a89ff494ab3b7718ddf035e811f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:30.676909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfec9a89ff494ab3b7718ddf035e811f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:30.729192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfec9a89ff494ab3b7718ddf035e811f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:30.730610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfec9a89ff494ab3b7718ddf035e811f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:30.758939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:30.794692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 838/1649] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:36:30 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:30.897292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 812/1650] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:36:30 2022] DELETE /identity/v3/users/cfec9a89ff494ab3b7718ddf035e811f => generated 0 bytes in 806 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:36:30.902285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf87e-9a4e-493e-b41f-c3c76b0f9229 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:30.902622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf87e-9a4e-493e-b41f-c3c76b0f9229 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:30.902860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf87e-9a4e-493e-b41f-c3c76b0f9229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:30.937697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:30.940051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:30.942823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d05bf87e-9a4e-493e-b41f-c3c76b0f9229 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:30.944513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d05bf87e-9a4e-493e-b41f-c3c76b0f9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:31.068282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75b310-8819-4c5b-b50f-4cc8cf7038d9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:31.083104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49161f9c-072f-4a37-874e-4809e31a5dac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:31.084372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49161f9c-072f-4a37-874e-4809e31a5dac service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:31.084647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49161f9c-072f-4a37-874e-4809e31a5dac service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:31.085423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49161f9c-072f-4a37-874e-4809e31a5dac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:31.086796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 839/1651] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:31.102672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49161f9c-072f-4a37-874e-4809e31a5dac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:31.104723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49161f9c-072f-4a37-874e-4809e31a5dac service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:31.119217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 813/1652] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:30 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:31.134903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bf87e-9a4e-493e-b41f-c3c76b0f9229 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:31.148138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bf87e-9a4e-493e-b41f-c3c76b0f9229 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:31.151947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f03418-db51-4660-b5c7-931d453b421b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:31.152701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f03418-db51-4660-b5c7-931d453b421b service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:31.153049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f03418-db51-4660-b5c7-931d453b421b service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:31.153390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f03418-db51-4660-b5c7-931d453b421b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:31.172261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f03418-db51-4660-b5c7-931d453b421b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:31.177365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f03418-db51-4660-b5c7-931d453b421b service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:31.199265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 840/1653] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:31.336262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:32.090129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:33.423805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49161f9c-072f-4a37-874e-4809e31a5dac service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:33.426247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-49161f9c-072f-4a37-874e-4809e31a5dac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:33.461239 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49161f9c-072f-4a37-874e-4809e31a5dac service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:33.497901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:33.499066 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:33.501577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:33.502049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] PATH_INFO: `/v3/projects/b8c00a254f984ace8b02d68d030d4155` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:33.505384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8c00a254f984ace8b02d68d030d4155)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:33.507670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:33.779616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8c00a254f984ace8b02d68d030d4155', 'request_id': 'req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:33.795094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8c00a254f984ace8b02d68d030d4155', 'request_id': 'req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:33.807954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8c00a254f984ace8b02d68d030d4155', 'request_id': 'req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:34.044522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] The token cache is being invalidate because project b8c00a254f984ace8b02d68d030d4155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:36:34.045173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:34.047359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-eebde462-0da7-4704-8bf5-dbfc8c6ce8b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:34.057894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f03418-db51-4660-b5c7-931d453b421b service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:34.061050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 814/1654] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:36:33 2022] DELETE /identity/v3/projects/b8c00a254f984ace8b02d68d030d4155 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:34.082307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f03418-db51-4660-b5c7-931d453b421b service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:34.283220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aa52b-cdc1-4bc8-b41e-8ed3fede8226 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:34.283516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aa52b-cdc1-4bc8-b41e-8ed3fede8226 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:34.283796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90aa52b-cdc1-4bc8-b41e-8ed3fede8226 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:34.285231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 815/1655] 10.222.0.24 () {54 vars in 960 bytes} [Wed May 25 07:36:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:36:34.290853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467173-e8d4-4406-b874-8acd471c075a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:34.291859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467173-e8d4-4406-b874-8acd471c075a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:34.292231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8467173-e8d4-4406-b874-8acd471c075a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:34.333156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:34.334549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:34.334933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:34.335349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] PATH_INFO: `/v3/users/f301679147334a31b427caf28e2648a5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:34.337187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f301679147334a31b427caf28e2648a5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:34.348779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:34.350163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f8467173-e8d4-4406-b874-8acd471c075a None None] MFA Rules not processed for user `762b38d08d2447bfbc968245a5b2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:34.353880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f8467173-e8d4-4406-b874-8acd471c075a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:34.495003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 816/1656] 10.222.0.24 () {58 vars in 1057 bytes} [Wed May 25 07:36:34 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:34.503300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467173-e8d4-4406-b874-8acd471c075a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:34.526936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8467173-e8d4-4406-b874-8acd471c075a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:34.559716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:34.560641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:34.560929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:34.561839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:34.570299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:34.593255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:34.602830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:34.605498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:34.650345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 817/1657] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:36:34.668151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f301679147334a31b427caf28e2648a5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:34.709071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f301679147334a31b427caf28e2648a5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:34.805110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f301679147334a31b427caf28e2648a5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:34.805811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f301679147334a31b427caf28e2648a5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:34.806710 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16899762-e69d-461c-a982-6ac892e00e50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f301679147334a31b427caf28e2648a5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:34.845892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 841/1658] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:36:34 2022] DELETE /identity/v3/users/f301679147334a31b427caf28e2648a5 => generated 0 bytes in 785 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:37.106779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:37.113411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:37.169046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c0b4bb-2cdb-421b-95a8-30710650c1d5 service placement] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:37.266982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:37.268193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:37.269184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:37.269548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] PATH_INFO: `/v3/projects/4de53696f22f44d9ba77f5fad9f7f66e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:37.271765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4de53696f22f44d9ba77f5fad9f7f66e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:37.274767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:37.479225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4de53696f22f44d9ba77f5fad9f7f66e', 'request_id': 'req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:37.493117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4de53696f22f44d9ba77f5fad9f7f66e', 'request_id': 'req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:37.512530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4de53696f22f44d9ba77f5fad9f7f66e', 'request_id': 'req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:37.613980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] The token cache is being invalidate because project 4de53696f22f44d9ba77f5fad9f7f66e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:36:37.614611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:37.615379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ac62a3e4-e6cc-4229-bb34-3acee9ef279b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:37.617912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 818/1659] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:36:37 2022] DELETE /identity/v3/projects/4de53696f22f44d9ba77f5fad9f7f66e => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:37.622862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee066e-901c-451e-9450-8c9f930846b1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:37.623706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee066e-901c-451e-9450-8c9f930846b1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:37.623994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdee066e-901c-451e-9450-8c9f930846b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:37.670483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bdee066e-901c-451e-9450-8c9f930846b1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:37.672513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bdee066e-901c-451e-9450-8c9f930846b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:37.816525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:37.862019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 842/1660] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:37.864623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3d254-7aa9-48f6-a10d-2260d566f6cb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:37.866334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3d254-7aa9-48f6-a10d-2260d566f6cb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:37.866629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3d254-7aa9-48f6-a10d-2260d566f6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:37.902715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-08a3d254-7aa9-48f6-a10d-2260d566f6cb None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:37.902715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-08a3d254-7aa9-48f6-a10d-2260d566f6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:37.918704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 819/1661] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:37.919942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee066e-901c-451e-9450-8c9f930846b1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:37.939004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdee066e-901c-451e-9450-8c9f930846b1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:37.943963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba070eb-709a-4da4-ad30-4100de536cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:37.944675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba070eb-709a-4da4-ad30-4100de536cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:37.944956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba070eb-709a-4da4-ad30-4100de536cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:37.945229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba070eb-709a-4da4-ad30-4100de536cd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:37.945977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba070eb-709a-4da4-ad30-4100de536cd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:37.946280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba070eb-709a-4da4-ad30-4100de536cd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:37.947944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba070eb-709a-4da4-ad30-4100de536cd3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:37.995294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 843/1662] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:37.999741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3d254-7aa9-48f6-a10d-2260d566f6cb None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:38.018434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3d254-7aa9-48f6-a10d-2260d566f6cb None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:38.032414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30cce7-0e26-495e-b742-822f8dac3748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:38.033140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30cce7-0e26-495e-b742-822f8dac3748 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:38.033420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30cce7-0e26-495e-b742-822f8dac3748 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:38.033696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30cce7-0e26-495e-b742-822f8dac3748 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:38.034412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30cce7-0e26-495e-b742-822f8dac3748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:38.036326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30cce7-0e26-495e-b742-822f8dac3748 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:38.154653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 820/1663] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:37 2022] POST /identity/v3/projects => generated 379 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:38.160735 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba070eb-709a-4da4-ad30-4100de536cd3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:38.176950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba070eb-709a-4da4-ad30-4100de536cd3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:38.303204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95113e1-8765-4b0b-a7c3-67e9109185f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:38.303912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95113e1-8765-4b0b-a7c3-67e9109185f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:38.304194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95113e1-8765-4b0b-a7c3-67e9109185f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:38.304467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95113e1-8765-4b0b-a7c3-67e9109185f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:38.305277 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95113e1-8765-4b0b-a7c3-67e9109185f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:38.307258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95113e1-8765-4b0b-a7c3-67e9109185f9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:38.418507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7485-796b-4a68-8196-8964ca690733 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:38.418800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7485-796b-4a68-8196-8964ca690733 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:38.419076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a7485-796b-4a68-8196-8964ca690733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:38.454039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 844/1664] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:38 2022] POST /identity/v3/users => generated 290 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:38.458991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95113e1-8765-4b0b-a7c3-67e9109185f9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:38.484758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-470a7485-796b-4a68-8196-8964ca690733 None None] MFA Rules not processed for user `f90f0f6afda54e80bc319dc5bdb80ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:38.486500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-470a7485-796b-4a68-8196-8964ca690733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:38.492265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95113e1-8765-4b0b-a7c3-67e9109185f9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:38.507409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26689d-08e6-48a4-9aee-bf855f17a801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:38.508105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26689d-08e6-48a4-9aee-bf855f17a801 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:38.508387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26689d-08e6-48a4-9aee-bf855f17a801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:38.508688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26689d-08e6-48a4-9aee-bf855f17a801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:38.509926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26689d-08e6-48a4-9aee-bf855f17a801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:38.511982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26689d-08e6-48a4-9aee-bf855f17a801 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:38.541708 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 845/1665] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:36:38.542666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26689d-08e6-48a4-9aee-bf855f17a801 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:38.566488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26689d-08e6-48a4-9aee-bf855f17a801 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:38.587356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771820b-de11-41c9-8e61-a794557bf44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:38.591595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771820b-de11-41c9-8e61-a794557bf44a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:38.591595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771820b-de11-41c9-8e61-a794557bf44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:38.596298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771820b-de11-41c9-8e61-a794557bf44a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:38.597250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771820b-de11-41c9-8e61-a794557bf44a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:38.598876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a771820b-de11-41c9-8e61-a794557bf44a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:38.612318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:38.625652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 846/1666] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:38.636230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771820b-de11-41c9-8e61-a794557bf44a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:38.653099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771820b-de11-41c9-8e61-a794557bf44a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:38.670102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9869ce-eec3-45a0-9bbb-e43006b2ec64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:38.671418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 821/1667] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:36:38.672669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9869ce-eec3-45a0-9bbb-e43006b2ec64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:38.672669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9869ce-eec3-45a0-9bbb-e43006b2ec64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:38.672817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9869ce-eec3-45a0-9bbb-e43006b2ec64 admin admin] PATH_INFO: `/v3/projects/b52499437c614a67b15ef37a8bb269f7/users/271fbd83b767435883a3b9c889898163/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:38.681824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e457310-59ab-4d0d-bf7b-f39429263a47 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:38.682251 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e457310-59ab-4d0d-bf7b-f39429263a47 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:38.682706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e457310-59ab-4d0d-bf7b-f39429263a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:38.701903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9869ce-eec3-45a0-9bbb-e43006b2ec64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52499437c614a67b15ef37a8bb269f7, user_id=271fbd83b767435883a3b9c889898163, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:38.705299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9869ce-eec3-45a0-9bbb-e43006b2ec64 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:38.722845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4e457310-59ab-4d0d-bf7b-f39429263a47 None None] MFA Rules not processed for user `f90f0f6afda54e80bc319dc5bdb80ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:38.724218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4e457310-59ab-4d0d-bf7b-f39429263a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:38.748080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 822/1668] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:38.764448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e457310-59ab-4d0d-bf7b-f39429263a47 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:38.767013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4e457310-59ab-4d0d-bf7b-f39429263a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:38.822340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 847/1669] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:38 2022] PUT /identity/v3/projects/b52499437c614a67b15ef37a8bb269f7/users/271fbd83b767435883a3b9c889898163/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:38.833933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0d58-addb-45ea-b1d4-945466e2bbeb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:38.834328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0d58-addb-45ea-b1d4-945466e2bbeb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:38.835275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc0d58-addb-45ea-b1d4-945466e2bbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:38.900065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9dfc0d58-addb-45ea-b1d4-945466e2bbeb None None] MFA Rules not processed for user `271fbd83b767435883a3b9c889898163`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:38.901626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9dfc0d58-addb-45ea-b1d4-945466e2bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:38.915286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e457310-59ab-4d0d-bf7b-f39429263a47 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:39.040532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 848/1670] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:39.045464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc0d58-addb-45ea-b1d4-945466e2bbeb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:39.060329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca799600-9872-4f59-bd55-7a5a9ca2fbc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:39.061039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca799600-9872-4f59-bd55-7a5a9ca2fbc1 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:39.061323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca799600-9872-4f59-bd55-7a5a9ca2fbc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:39.063938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca799600-9872-4f59-bd55-7a5a9ca2fbc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:39.091049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:39.154748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca799600-9872-4f59-bd55-7a5a9ca2fbc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:39.158007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca799600-9872-4f59-bd55-7a5a9ca2fbc1 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:39.181549 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 823/1671] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:38 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:36:39.296651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc0d58-addb-45ea-b1d4-945466e2bbeb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:39.321109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325363e8-0888-4172-9494-cedfa97f2313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:39.322841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325363e8-0888-4172-9494-cedfa97f2313 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:39.323135 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325363e8-0888-4172-9494-cedfa97f2313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:39.323795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325363e8-0888-4172-9494-cedfa97f2313 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:39.324662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325363e8-0888-4172-9494-cedfa97f2313 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:39.328147 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325363e8-0888-4172-9494-cedfa97f2313 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:39.504315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 849/1672] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:39 2022] POST /identity/v3/projects => generated 381 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:36:39.507388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca799600-9872-4f59-bd55-7a5a9ca2fbc1 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:39.524118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca799600-9872-4f59-bd55-7a5a9ca2fbc1 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:39.554502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:39.676291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfc897-34bb-4b96-87fe-c6def59a7149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:39.676291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfc897-34bb-4b96-87fe-c6def59a7149 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:39.676291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfc897-34bb-4b96-87fe-c6def59a7149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:39.676291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfc897-34bb-4b96-87fe-c6def59a7149 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:39.676726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfc897-34bb-4b96-87fe-c6def59a7149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:39.676726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfc897-34bb-4b96-87fe-c6def59a7149 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:39.821507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 824/1673] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:39 2022] POST /identity/v3/users => generated 297 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:39.823250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325363e8-0888-4172-9494-cedfa97f2313 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:39.836643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325363e8-0888-4172-9494-cedfa97f2313 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:39.846551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406041-8941-4cf8-a12c-da062df3c7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:39.847237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406041-8941-4cf8-a12c-da062df3c7f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:39.847518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406041-8941-4cf8-a12c-da062df3c7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:39.847793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406041-8941-4cf8-a12c-da062df3c7f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:39.848659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406041-8941-4cf8-a12c-da062df3c7f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:39.851769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406041-8941-4cf8-a12c-da062df3c7f4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:39.902240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 850/1674] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:36:39.907148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfc897-34bb-4b96-87fe-c6def59a7149 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:39.923363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfc897-34bb-4b96-87fe-c6def59a7149 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:39.939996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334d0502-c9e1-4784-b264-0b1ede877984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:39.940872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0502-c9e1-4784-b264-0b1ede877984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:39.941152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0502-c9e1-4784-b264-0b1ede877984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:39.941426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334d0502-c9e1-4784-b264-0b1ede877984 admin admin] PATH_INFO: `/v3/projects/8a1fed5f2a894c4eb248b9fdef2a9b62/users/4f705a9715fe4e8b826bd2487e8aa93f/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:39.961435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0502-c9e1-4784-b264-0b1ede877984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1fed5f2a894c4eb248b9fdef2a9b62, user_id=4f705a9715fe4e8b826bd2487e8aa93f, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:39.964331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334d0502-c9e1-4784-b264-0b1ede877984 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:40.083115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 825/1675] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:39 2022] PUT /identity/v3/projects/8a1fed5f2a894c4eb248b9fdef2a9b62/users/4f705a9715fe4e8b826bd2487e8aa93f/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:40.084837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406041-8941-4cf8-a12c-da062df3c7f4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:40.106038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406041-8941-4cf8-a12c-da062df3c7f4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:40.376127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b377f-7198-4212-b348-fe8afe5aec0d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:40.376748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b377f-7198-4212-b348-fe8afe5aec0d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:40.376748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b377f-7198-4212-b348-fe8afe5aec0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:40.487054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-623b377f-7198-4212-b348-fe8afe5aec0d None None] MFA Rules not processed for user `0487ea9076ee4baf8138fdc25ce02522`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:40.488289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-623b377f-7198-4212-b348-fe8afe5aec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:40.647415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 826/1676] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:40.664790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b377f-7198-4212-b348-fe8afe5aec0d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:40.670373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-623b377f-7198-4212-b348-fe8afe5aec0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:40.678186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffd422-380b-4a91-b746-1c0b04c1bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:40.678922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffd422-380b-4a91-b746-1c0b04c1bed5 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:40.680348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffd422-380b-4a91-b746-1c0b04c1bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:40.682656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ffd422-380b-4a91-b746-1c0b04c1bed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:40.683576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ffd422-380b-4a91-b746-1c0b04c1bed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:40.690723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ffd422-380b-4a91-b746-1c0b04c1bed5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:40.729005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 851/1677] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:40 2022] GET /identity/v3/roles => generated 1420 bytes in 644 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:40.731243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffd422-380b-4a91-b746-1c0b04c1bed5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:40.770355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ffd422-380b-4a91-b746-1c0b04c1bed5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:40.793268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07da2ea-4a96-4eab-8490-a0b585228dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:40.794438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07da2ea-4a96-4eab-8490-a0b585228dd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:40.794830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07da2ea-4a96-4eab-8490-a0b585228dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:40.795210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07da2ea-4a96-4eab-8490-a0b585228dd4 admin admin] PATH_INFO: `/v3/projects/8a1fed5f2a894c4eb248b9fdef2a9b62/users/4f705a9715fe4e8b826bd2487e8aa93f/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:40.804301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07da2ea-4a96-4eab-8490-a0b585228dd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1fed5f2a894c4eb248b9fdef2a9b62, user_id=4f705a9715fe4e8b826bd2487e8aa93f, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:40.807365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07da2ea-4a96-4eab-8490-a0b585228dd4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:40.867766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 852/1678] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:40 2022] PUT /identity/v3/projects/8a1fed5f2a894c4eb248b9fdef2a9b62/users/4f705a9715fe4e8b826bd2487e8aa93f/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:40.879300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105851e9-4d61-4443-b024-e81e915122e8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:40.879677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105851e9-4d61-4443-b024-e81e915122e8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:40.880173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105851e9-4d61-4443-b024-e81e915122e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:40.915567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b377f-7198-4212-b348-fe8afe5aec0d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:40.931855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:40.975519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-105851e9-4d61-4443-b024-e81e915122e8 None None] MFA Rules not processed for user `4f705a9715fe4e8b826bd2487e8aa93f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:40.985044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-105851e9-4d61-4443-b024-e81e915122e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:41.029638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a93fe-fd7f-44b1-9c9e-36e6705b1b90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:41.030470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a93fe-fd7f-44b1-9c9e-36e6705b1b90 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:41.030906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a93fe-fd7f-44b1-9c9e-36e6705b1b90 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:41.031702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a93fe-fd7f-44b1-9c9e-36e6705b1b90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:41.154223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:41.178235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 853/1679] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:40 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:36:41.192108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105851e9-4d61-4443-b024-e81e915122e8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:41.193758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-105851e9-4d61-4443-b024-e81e915122e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:41.198010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a93fe-fd7f-44b1-9c9e-36e6705b1b90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:41.206598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a93fe-fd7f-44b1-9c9e-36e6705b1b90 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:41.245283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 827/1680] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:41.461245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105851e9-4d61-4443-b024-e81e915122e8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:41.478165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c470b3c4-f7bf-4389-a701-6c038c7cd67d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:41.479454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470b3c4-f7bf-4389-a701-6c038c7cd67d service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:41.479454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470b3c4-f7bf-4389-a701-6c038c7cd67d service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:41.479648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c470b3c4-f7bf-4389-a701-6c038c7cd67d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:41.515061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470b3c4-f7bf-4389-a701-6c038c7cd67d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:41.516912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c470b3c4-f7bf-4389-a701-6c038c7cd67d service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:41.545701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 854/1681] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:36:42.299476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1fe54-eb7d-49e5-a8ac-51a9d4e07b64 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:42.300070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1fe54-eb7d-49e5-a8ac-51a9d4e07b64 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:42.300070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1fe54-eb7d-49e5-a8ac-51a9d4e07b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:42.371697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-90e1fe54-eb7d-49e5-a8ac-51a9d4e07b64 None None] MFA Rules not processed for user `f90f0f6afda54e80bc319dc5bdb80ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:42.376788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-90e1fe54-eb7d-49e5-a8ac-51a9d4e07b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:42.570292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 828/1682] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:43.433939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf01e-3d50-4467-bfd9-c9be89a54608 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:43.434417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf01e-3d50-4467-bfd9-c9be89a54608 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:43.434500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cf01e-3d50-4467-bfd9-c9be89a54608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:43.473190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4d9cf01e-3d50-4467-bfd9-c9be89a54608 None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:43.474717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4d9cf01e-3d50-4467-bfd9-c9be89a54608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:43.553061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1fe54-eb7d-49e5-a8ac-51a9d4e07b64 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:43.594654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1fe54-eb7d-49e5-a8ac-51a9d4e07b64 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:43.609974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93779043-37e8-462a-af32-2fbe03301fa8 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f705a9715fe4e8b826bd2487e8aa93f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a1fed5f2a894c4eb248b9fdef2a9b62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:43.611147 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93779043-37e8-462a-af32-2fbe03301fa8 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:43.611563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93779043-37e8-462a-af32-2fbe03301fa8 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:43.612034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93779043-37e8-462a-af32-2fbe03301fa8 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:43.613006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93779043-37e8-462a-af32-2fbe03301fa8 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:43.613477 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93779043-37e8-462a-af32-2fbe03301fa8 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:43.615439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93779043-37e8-462a-af32-2fbe03301fa8 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:43.658090 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 829/1683] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:43.659224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93779043-37e8-462a-af32-2fbe03301fa8 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:43.667664 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 855/1684] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:36:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:43.690681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93779043-37e8-462a-af32-2fbe03301fa8 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:43.699224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9f2b-0136-4826-9aab-d1dc8d4bd926 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f705a9715fe4e8b826bd2487e8aa93f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a1fed5f2a894c4eb248b9fdef2a9b62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:43.700236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9f2b-0136-4826-9aab-d1dc8d4bd926 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:43.704752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9f2b-0136-4826-9aab-d1dc8d4bd926 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:43.705099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d9f2b-0136-4826-9aab-d1dc8d4bd926 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:43.712845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d9f2b-0136-4826-9aab-d1dc8d4bd926 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:43.712845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687d9f2b-0136-4826-9aab-d1dc8d4bd926 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:43.922466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 830/1685] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:43 2022] POST /identity/v3/projects => generated 354 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:43.927075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf01e-3d50-4467-bfd9-c9be89a54608 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:43.960143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cf01e-3d50-4467-bfd9-c9be89a54608 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:44.091577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438f5b9-5e79-4df7-bc27-202d6087d7a6 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f705a9715fe4e8b826bd2487e8aa93f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a1fed5f2a894c4eb248b9fdef2a9b62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:44.092271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438f5b9-5e79-4df7-bc27-202d6087d7a6 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:44.092575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438f5b9-5e79-4df7-bc27-202d6087d7a6 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:44.094064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f438f5b9-5e79-4df7-bc27-202d6087d7a6 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:44.094064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438f5b9-5e79-4df7-bc27-202d6087d7a6 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:44.094064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438f5b9-5e79-4df7-bc27-202d6087d7a6 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:44.095755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f438f5b9-5e79-4df7-bc27-202d6087d7a6 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:44.149410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 856/1686] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:44.225386 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9f2b-0136-4826-9aab-d1dc8d4bd926 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:44.227267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-687d9f2b-0136-4826-9aab-d1dc8d4bd926 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:44.262898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:44.285854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438f5b9-5e79-4df7-bc27-202d6087d7a6 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:44.307259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f438f5b9-5e79-4df7-bc27-202d6087d7a6 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:44.314463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f705a9715fe4e8b826bd2487e8aa93f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8a1fed5f2a894c4eb248b9fdef2a9b62', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:44.315679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:44.315858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:44.316226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] PATH_INFO: `/v3/projects/2fd003e532c947419c789a9879edc7e2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:44.318002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Authorizing `identity:delete_project(project_id=2fd003e532c947419c789a9879edc7e2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:44.319188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: WARNING py.warnings [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 07:36:44.319188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: warnings.warn(msg) May 25 07:36:44.319188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: May 25 07:36:44.321392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:44.462880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:44.476392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687d9f2b-0136-4826-9aab-d1dc8d4bd926 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:44.550186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fd003e532c947419c789a9879edc7e2', 'request_id': 'req-4682d14e-3e3f-464d-a751-b2aca15fc5a7'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:44.588909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fd003e532c947419c789a9879edc7e2', 'request_id': 'req-4682d14e-3e3f-464d-a751-b2aca15fc5a7'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:44.618650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fd003e532c947419c789a9879edc7e2', 'request_id': 'req-4682d14e-3e3f-464d-a751-b2aca15fc5a7'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:44.725710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0b901e-16e4-42ac-a702-4ce0ef6e5578 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:44.727075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b901e-16e4-42ac-a702-4ce0ef6e5578 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:44.727826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b901e-16e4-42ac-a702-4ce0ef6e5578 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:44.728306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0b901e-16e4-42ac-a702-4ce0ef6e5578 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:44.747454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] The token cache is being invalidate because project 2fd003e532c947419c789a9879edc7e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:36:44.747454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:44.747454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:44.747454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 857/1687] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:36:44 2022] DELETE /identity/v3/projects/2fd003e532c947419c789a9879edc7e2 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:36:44.747870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:44.753120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:44.896282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b901e-16e4-42ac-a702-4ce0ef6e5578 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:44.898349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0b901e-16e4-42ac-a702-4ce0ef6e5578 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:44.931404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 831/1688] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:36:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 706 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:36:44.934394 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ea3ae-09b4-4021-92ee-c40eb8b4289c None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:44.935091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ea3ae-09b4-4021-92ee-c40eb8b4289c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:44.935834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ea3ae-09b4-4021-92ee-c40eb8b4289c None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:44.944448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 832/1689] 10.222.0.24 () {54 vars in 912 bytes} [Wed May 25 07:36:44 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:36:44.946893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8dd48-6aac-4547-9d16-7d3b09f36a86 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:44.947399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8dd48-6aac-4547-9d16-7d3b09f36a86 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:44.947879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d8dd48-6aac-4547-9d16-7d3b09f36a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:44.986980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682d14e-3e3f-464d-a751-b2aca15fc5a7 tempest-VolumeQuotaClassesTest-1644118749 tempest-VolumeQuotaClassesTest-1644118749-project-admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:44.996600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-71d8dd48-6aac-4547-9d16-7d3b09f36a86 None None] MFA Rules not processed for user `a5f94913ac8a463db617fbe30df395b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:45.037322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-71d8dd48-6aac-4547-9d16-7d3b09f36a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:45.046788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:45.050602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:45.055694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:45.058716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] PATH_INFO: `/v3/users/fe098a4d40404eb89bd1d7b552c68654` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:45.069559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe098a4d40404eb89bd1d7b552c68654)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:45.075855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:45.313960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 833/1690] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:36:44 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:45.318153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92058af-c017-4b1d-99c5-000e5b522d4b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:45.318451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92058af-c017-4b1d-99c5-000e5b522d4b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:45.318816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92058af-c017-4b1d-99c5-000e5b522d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:45.352262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:45.410167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a92058af-c017-4b1d-99c5-000e5b522d4b None None] MFA Rules not processed for user `28d83ef95cda448dbd72acbd13a5f008`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:45.423200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a92058af-c017-4b1d-99c5-000e5b522d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:45.568931 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 834/1691] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:45.570003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92058af-c017-4b1d-99c5-000e5b522d4b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:45.571698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a92058af-c017-4b1d-99c5-000e5b522d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:45.618686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe098a4d40404eb89bd1d7b552c68654'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:45.631764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92058af-c017-4b1d-99c5-000e5b522d4b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:45.643046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657abb1-0a0e-4c00-bc54-08c3cfddd448 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:45.644400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657abb1-0a0e-4c00-bc54-08c3cfddd448 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:45.644965 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657abb1-0a0e-4c00-bc54-08c3cfddd448 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:45.645759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe098a4d40404eb89bd1d7b552c68654'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:45.646644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657abb1-0a0e-4c00-bc54-08c3cfddd448 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:45.672504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657abb1-0a0e-4c00-bc54-08c3cfddd448 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:45.677641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657abb1-0a0e-4c00-bc54-08c3cfddd448 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:45.693219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 835/1692] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:45.785665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657abb1-0a0e-4c00-bc54-08c3cfddd448 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:45.790883 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a657abb1-0a0e-4c00-bc54-08c3cfddd448 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:45.813661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe098a4d40404eb89bd1d7b552c68654'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:45.815612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe098a4d40404eb89bd1d7b552c68654'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:45.816454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bf498df4-b7e3-49bf-a66c-2153396e119b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe098a4d40404eb89bd1d7b552c68654'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:45.853478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 858/1693] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:36:44 2022] DELETE /identity/v3/users/fe098a4d40404eb89bd1d7b552c68654 => generated 0 bytes in 1106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:45.858322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689c1f3-81b9-4ef9-8748-0f9902c60093 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:45.859560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689c1f3-81b9-4ef9-8748-0f9902c60093 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:45.860034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1689c1f3-81b9-4ef9-8748-0f9902c60093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:45.934123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1689c1f3-81b9-4ef9-8748-0f9902c60093 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:45.940389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1689c1f3-81b9-4ef9-8748-0f9902c60093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:46.040616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657abb1-0a0e-4c00-bc54-08c3cfddd448 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:46.059400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:46.131799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 859/1694] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:46.137772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689c1f3-81b9-4ef9-8748-0f9902c60093 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:46.142252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1689c1f3-81b9-4ef9-8748-0f9902c60093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:46.177321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1689c1f3-81b9-4ef9-8748-0f9902c60093 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:46.192144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:46.195173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:46.196496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:46.196496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] PATH_INFO: `/v3/users/271fbd83b767435883a3b9c889898163` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:46.201851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271fbd83b767435883a3b9c889898163)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:46.208330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:46.282848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:46.283569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:46.283856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:46.284129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:46.296356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:46.562678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:46.562678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:46.562678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 836/1695] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:46.562678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:46.562678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:46.638049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d84730b-ec6f-4be7-91fd-6b1a388d517e service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:46.659743 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59630ec0-42eb-49ae-a452-7008677f9dff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:46.660126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630ec0-42eb-49ae-a452-7008677f9dff service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:46.660380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630ec0-42eb-49ae-a452-7008677f9dff service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:46.660684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59630ec0-42eb-49ae-a452-7008677f9dff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:46.680579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59630ec0-42eb-49ae-a452-7008677f9dff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:46.682262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59630ec0-42eb-49ae-a452-7008677f9dff service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:46.699521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 837/1696] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:46.792934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35894337-b833-4e1d-be76-96bf0cee20f3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:46.794065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35894337-b833-4e1d-be76-96bf0cee20f3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:46.794595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35894337-b833-4e1d-be76-96bf0cee20f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:46.845043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-35894337-b833-4e1d-be76-96bf0cee20f3 None None] MFA Rules not processed for user `18eb8b615526451498d3adc382d5a410`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:46.847487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-35894337-b833-4e1d-be76-96bf0cee20f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:47.006025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 838/1697] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:47.111836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35894337-b833-4e1d-be76-96bf0cee20f3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:47.113573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-35894337-b833-4e1d-be76-96bf0cee20f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:47.159770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35894337-b833-4e1d-be76-96bf0cee20f3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:47.172781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a749b6f8-2605-4e0b-a6d4-949f819d72d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:47.173386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271fbd83b767435883a3b9c889898163'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:47.173941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749b6f8-2605-4e0b-a6d4-949f819d72d4 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:47.174039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749b6f8-2605-4e0b-a6d4-949f819d72d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:47.174465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a749b6f8-2605-4e0b-a6d4-949f819d72d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:47.192947 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749b6f8-2605-4e0b-a6d4-949f819d72d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:47.196052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a749b6f8-2605-4e0b-a6d4-949f819d72d4 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:47.224576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:47.229544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271fbd83b767435883a3b9c889898163'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:47.232774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 839/1698] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:47.341026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271fbd83b767435883a3b9c889898163'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:47.342129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271fbd83b767435883a3b9c889898163'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:47.344870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271fbd83b767435883a3b9c889898163'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:47.380447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 860/1699] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:36:46 2022] DELETE /identity/v3/users/271fbd83b767435883a3b9c889898163 => generated 0 bytes in 1246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:47.382183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdb5aa-fdf3-4171-bf8b-9eb61ecd4048 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:47.382511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdb5aa-fdf3-4171-bf8b-9eb61ecd4048 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:47.382811 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befdb5aa-fdf3-4171-bf8b-9eb61ecd4048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:47.480668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-befdb5aa-fdf3-4171-bf8b-9eb61ecd4048 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:47.491895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-befdb5aa-fdf3-4171-bf8b-9eb61ecd4048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:47.503763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:47.505919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:47.678165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27d4702-fd79-412f-82fd-c4658149f1e0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:47.697517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:47.698526 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:47.699877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:47.700388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:47.700918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] PATH_INFO: `/v3/users/2cf9329954c649f788aeba72ef3b011c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:47.709594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf9329954c649f788aeba72ef3b011c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:47.717896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:47.742764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 840/1700] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:47.824694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdb5aa-fdf3-4171-bf8b-9eb61ecd4048 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:47.830764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-befdb5aa-fdf3-4171-bf8b-9eb61ecd4048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:48.017422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befdb5aa-fdf3-4171-bf8b-9eb61ecd4048 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:48.024751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd147ef-e78d-438a-ab70-606947999be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:48.025931 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd147ef-e78d-438a-ab70-606947999be0 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:48.026541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd147ef-e78d-438a-ab70-606947999be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:48.027012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd147ef-e78d-438a-ab70-606947999be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:48.040878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd147ef-e78d-438a-ab70-606947999be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:48.043507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd147ef-e78d-438a-ab70-606947999be0 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:48.061047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf9329954c649f788aeba72ef3b011c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:48.069785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 841/1701] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:36:48.098750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf9329954c649f788aeba72ef3b011c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:48.226937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf9329954c649f788aeba72ef3b011c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:48.227960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf9329954c649f788aeba72ef3b011c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:48.228537 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf9329954c649f788aeba72ef3b011c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:48.254398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 861/1702] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:36:47 2022] DELETE /identity/v3/users/2cf9329954c649f788aeba72ef3b011c => generated 0 bytes in 748 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:48.261598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897236a-1fdd-456c-a2da-74d6896b8616 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:48.261598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897236a-1fdd-456c-a2da-74d6896b8616 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:48.261598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6897236a-1fdd-456c-a2da-74d6896b8616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:48.306299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6897236a-1fdd-456c-a2da-74d6896b8616 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:48.307555 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6897236a-1fdd-456c-a2da-74d6896b8616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:48.544583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 842/1703] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:48.780303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:48.783537 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:48.785646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:48.995577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd798d13-09db-46af-a672-2ef12a70bee3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:49.005930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f511c7-e4d9-45d3-ae41-b4ed324d7a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:49.007124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f511c7-e4d9-45d3-ae41-b4ed324d7a75 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:49.008292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f511c7-e4d9-45d3-ae41-b4ed324d7a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:49.009074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f511c7-e4d9-45d3-ae41-b4ed324d7a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:49.035298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f511c7-e4d9-45d3-ae41-b4ed324d7a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:49.036959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f511c7-e4d9-45d3-ae41-b4ed324d7a75 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:49.067541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 862/1704] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:49.415898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff16c9-00dd-42e3-b4d6-c254fc19375b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:49.416504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff16c9-00dd-42e3-b4d6-c254fc19375b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:49.416504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecff16c9-00dd-42e3-b4d6-c254fc19375b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:49.465779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ecff16c9-00dd-42e3-b4d6-c254fc19375b None None] MFA Rules not processed for user `a5f94913ac8a463db617fbe30df395b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:49.470646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ecff16c9-00dd-42e3-b4d6-c254fc19375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:49.493706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 843/1705] 10.222.0.41 () {58 vars in 1015 bytes} [Wed May 25 07:36:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:49.601246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f511c7-e4d9-45d3-ae41-b4ed324d7a75 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:49.608412 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e6f511c7-e4d9-45d3-ae41-b4ed324d7a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:49.636561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff16c9-00dd-42e3-b4d6-c254fc19375b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:49.638589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ecff16c9-00dd-42e3-b4d6-c254fc19375b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:49.639915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f511c7-e4d9-45d3-ae41-b4ed324d7a75 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:49.654673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecff16c9-00dd-42e3-b4d6-c254fc19375b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:49.666708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1ec58-0966-4f08-a661-e5d31907e5b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:49.668281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1ec58-0966-4f08-a661-e5d31907e5b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:49.668769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1ec58-0966-4f08-a661-e5d31907e5b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:49.669426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1ec58-0966-4f08-a661-e5d31907e5b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:49.678316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:49.687915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:49.688429 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:49.689405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] PATH_INFO: `/v3/projects/b52499437c614a67b15ef37a8bb269f7` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:49.691767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1ec58-0966-4f08-a661-e5d31907e5b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:49.693715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52499437c614a67b15ef37a8bb269f7)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:49.696576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1ec58-0966-4f08-a661-e5d31907e5b1 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:49.699682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:49.719061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 844/1706] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:49.937493 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1ec58-0966-4f08-a661-e5d31907e5b1 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:49.940007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a3b1ec58-0966-4f08-a661-e5d31907e5b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:49.965401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52499437c614a67b15ef37a8bb269f7', 'request_id': 'req-1030160d-863f-4a92-84db-60d6c12b6942'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:49.981549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52499437c614a67b15ef37a8bb269f7', 'request_id': 'req-1030160d-863f-4a92-84db-60d6c12b6942'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:49.985202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1ec58-0966-4f08-a661-e5d31907e5b1 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:50.012061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52499437c614a67b15ef37a8bb269f7', 'request_id': 'req-1030160d-863f-4a92-84db-60d6c12b6942'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.148268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] The token cache is being invalidate because project b52499437c614a67b15ef37a8bb269f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:36:50.148639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.149342 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.152142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 863/1707] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:36:49 2022] DELETE /identity/v3/projects/b52499437c614a67b15ef37a8bb269f7 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:50.153376 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:50.154415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:50.154611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:50.154832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] PATH_INFO: `/v3/projects/7b680101e6694c3a9d345c92ee378101` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:50.159844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:50.162438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:50.166548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b680101e6694c3a9d345c92ee378101)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:50.174013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:50.183925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:50.200831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1030160d-863f-4a92-84db-60d6c12b6942 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:50.215069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:50.215069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:50.215069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:50.215324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] PATH_INFO: `/v3/users/4f705a9715fe4e8b826bd2487e8aa93f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:50.228340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f705a9715fe4e8b826bd2487e8aa93f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:50.248064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:50.424384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b680101e6694c3a9d345c92ee378101', 'request_id': 'req-8ec368a5-b007-4faf-a051-fc2c4240e5ef'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.456146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b680101e6694c3a9d345c92ee378101', 'request_id': 'req-8ec368a5-b007-4faf-a051-fc2c4240e5ef'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.475310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b680101e6694c3a9d345c92ee378101', 'request_id': 'req-8ec368a5-b007-4faf-a051-fc2c4240e5ef'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.679959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] The token cache is being invalidate because project 7b680101e6694c3a9d345c92ee378101 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:36:50.680263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.680954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8ec368a5-b007-4faf-a051-fc2c4240e5ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.682738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 845/1708] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:36:49 2022] DELETE /identity/v3/projects/7b680101e6694c3a9d345c92ee378101 => generated 0 bytes in 746 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:50.689165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c849a04-e13b-4c79-964f-c2334088a63b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:50.689662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c849a04-e13b-4c79-964f-c2334088a63b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:50.690105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c849a04-e13b-4c79-964f-c2334088a63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:50.704984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f705a9715fe4e8b826bd2487e8aa93f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.756572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f705a9715fe4e8b826bd2487e8aa93f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.785440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3c849a04-e13b-4c79-964f-c2334088a63b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:50.791625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3c849a04-e13b-4c79-964f-c2334088a63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:50.878327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f705a9715fe4e8b826bd2487e8aa93f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.879308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f705a9715fe4e8b826bd2487e8aa93f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.880106 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b66a9379-3381-421a-8b08-4e0ceba21f84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f705a9715fe4e8b826bd2487e8aa93f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:50.913270 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 864/1709] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:36:50 2022] DELETE /identity/v3/users/4f705a9715fe4e8b826bd2487e8aa93f => generated 0 bytes in 757 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:51.007411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 846/1710] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:51.015841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ae9cc-9d4e-49ff-b39f-aec416269808 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:51.016503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ae9cc-9d4e-49ff-b39f-aec416269808 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:51.016987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ae9cc-9d4e-49ff-b39f-aec416269808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:51.077731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8a9ae9cc-9d4e-49ff-b39f-aec416269808 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:51.081252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8a9ae9cc-9d4e-49ff-b39f-aec416269808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:51.245435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 865/1711] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:51.249715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c849a04-e13b-4c79-964f-c2334088a63b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:51.264825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c849a04-e13b-4c79-964f-c2334088a63b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:51.302348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef8724-115f-49a3-924d-43c128e8503c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:51.303132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef8724-115f-49a3-924d-43c128e8503c admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:51.303533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef8724-115f-49a3-924d-43c128e8503c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:51.312340 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ef8724-115f-49a3-924d-43c128e8503c admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:51.314107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef8724-115f-49a3-924d-43c128e8503c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:51.314434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef8724-115f-49a3-924d-43c128e8503c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:51.321814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ef8724-115f-49a3-924d-43c128e8503c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:51.384103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 847/1712] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:51.385453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ae9cc-9d4e-49ff-b39f-aec416269808 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:51.397707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ae9cc-9d4e-49ff-b39f-aec416269808 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:51.441795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5c11d-ba87-4566-97c3-86e564e8a37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:51.442364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5c11d-ba87-4566-97c3-86e564e8a37f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:51.442693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5c11d-ba87-4566-97c3-86e564e8a37f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:51.442980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5c11d-ba87-4566-97c3-86e564e8a37f admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:51.449083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5c11d-ba87-4566-97c3-86e564e8a37f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:51.451178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5c11d-ba87-4566-97c3-86e564e8a37f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:51.623291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 866/1713] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:51 2022] POST /identity/v3/projects => generated 355 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:51.625309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef8724-115f-49a3-924d-43c128e8503c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:51.650557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ef8724-115f-49a3-924d-43c128e8503c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:51.673908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:51.865399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bf39e-0807-4c70-9a0d-7db408098096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:51.866252 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf39e-0807-4c70-9a0d-7db408098096 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:51.866542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf39e-0807-4c70-9a0d-7db408098096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:51.866819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bf39e-0807-4c70-9a0d-7db408098096 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:51.867536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bf39e-0807-4c70-9a0d-7db408098096 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:51.882652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bf39e-0807-4c70-9a0d-7db408098096 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:52.060438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 848/1714] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:51 2022] POST /identity/v3/users => generated 278 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:52.065516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5c11d-ba87-4566-97c3-86e564e8a37f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:52.079830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5c11d-ba87-4566-97c3-86e564e8a37f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:52.094311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644e5c8-6941-4a15-8539-1fec4a9531f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:52.095551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644e5c8-6941-4a15-8539-1fec4a9531f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:52.095988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644e5c8-6941-4a15-8539-1fec4a9531f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:52.098082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644e5c8-6941-4a15-8539-1fec4a9531f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:52.098082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644e5c8-6941-4a15-8539-1fec4a9531f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:52.117162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644e5c8-6941-4a15-8539-1fec4a9531f6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:52.149564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 867/1715] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:52.153811 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bf39e-0807-4c70-9a0d-7db408098096 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:52.191494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bf39e-0807-4c70-9a0d-7db408098096 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:52.213368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08749cc3-c868-4235-b598-70489c3c7e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:52.219655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08749cc3-c868-4235-b598-70489c3c7e29 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:52.219655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08749cc3-c868-4235-b598-70489c3c7e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:52.219655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08749cc3-c868-4235-b598-70489c3c7e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:52.219655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08749cc3-c868-4235-b598-70489c3c7e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:52.219655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08749cc3-c868-4235-b598-70489c3c7e29 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:52.242756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:52.263758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 849/1716] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:36:52.269050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644e5c8-6941-4a15-8539-1fec4a9531f6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:52.288400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644e5c8-6941-4a15-8539-1fec4a9531f6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:52.326669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e3b2-b05f-4755-b355-7029c94b1b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:52.328219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e3b2-b05f-4755-b355-7029c94b1b63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:52.328519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e3b2-b05f-4755-b355-7029c94b1b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:52.328801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7e3b2-b05f-4755-b355-7029c94b1b63 admin admin] PATH_INFO: `/v3/projects/5a9242ea370044668df6476c0bbb5cdb/users/9496d1c3fa004f9dbd9254d82c38a74e/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:52.377998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7e3b2-b05f-4755-b355-7029c94b1b63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9242ea370044668df6476c0bbb5cdb, user_id=9496d1c3fa004f9dbd9254d82c38a74e, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:52.380887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a7e3b2-b05f-4755-b355-7029c94b1b63 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:52.485650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 868/1717] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:52 2022] PUT /identity/v3/projects/5a9242ea370044668df6476c0bbb5cdb/users/9496d1c3fa004f9dbd9254d82c38a74e/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:52.506290 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd018c-b75d-4477-8f13-d1d560c3c0b4 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:52.506641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd018c-b75d-4477-8f13-d1d560c3c0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:52.506898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd018c-b75d-4477-8f13-d1d560c3c0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:52.613662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9ebd018c-b75d-4477-8f13-d1d560c3c0b4 None None] MFA Rules not processed for user `9496d1c3fa004f9dbd9254d82c38a74e`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:52.617228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9ebd018c-b75d-4477-8f13-d1d560c3c0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:52.771089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 850/1718] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:52 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:52.776811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e3b2-b05f-4755-b355-7029c94b1b63 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:53.041399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7e3b2-b05f-4755-b355-7029c94b1b63 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:53.064748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb517b2-2fa2-4834-8648-8d35eafc7516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:53.065511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb517b2-2fa2-4834-8648-8d35eafc7516 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:53.065999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb517b2-2fa2-4834-8648-8d35eafc7516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:53.067222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb517b2-2fa2-4834-8648-8d35eafc7516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:53.068239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb517b2-2fa2-4834-8648-8d35eafc7516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:53.076926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb517b2-2fa2-4834-8648-8d35eafc7516 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:53.258022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 869/1719] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:52 2022] POST /identity/v3/projects => generated 357 bytes in 483 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:53.262254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd018c-b75d-4477-8f13-d1d560c3c0b4 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:53.277642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd018c-b75d-4477-8f13-d1d560c3c0b4 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:53.420794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91514c-1893-4575-94b6-6f94f053a7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:53.422709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91514c-1893-4575-94b6-6f94f053a7ac admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:53.426300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91514c-1893-4575-94b6-6f94f053a7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:53.426300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91514c-1893-4575-94b6-6f94f053a7ac admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:53.426300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91514c-1893-4575-94b6-6f94f053a7ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:53.441007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91514c-1893-4575-94b6-6f94f053a7ac admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:53.555541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 851/1720] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:53 2022] POST /identity/v3/users => generated 285 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:53.556070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb517b2-2fa2-4834-8648-8d35eafc7516 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:53.558165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91514c-1893-4575-94b6-6f94f053a7ac admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:53.564918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0a91514c-1893-4575-94b6-6f94f053a7ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:53.570939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb517b2-2fa2-4834-8648-8d35eafc7516 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:53.621166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91514c-1893-4575-94b6-6f94f053a7ac admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:53.621557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fcf3a-433f-46be-bb5c-13373513ccdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:53.622422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fcf3a-433f-46be-bb5c-13373513ccdc admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:53.622860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fcf3a-433f-46be-bb5c-13373513ccdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:53.623350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9fcf3a-433f-46be-bb5c-13373513ccdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:53.625009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fcf3a-433f-46be-bb5c-13373513ccdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:53.626816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9fcf3a-433f-46be-bb5c-13373513ccdc admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:53.652727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:53.653592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:53.653825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:53.654108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] PATH_INFO: `/v3/projects/d5237b3b97634d7ea235040957b45aa5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:53.657756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5237b3b97634d7ea235040957b45aa5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:53.659483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 870/1721] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:53.663529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fcf3a-433f-46be-bb5c-13373513ccdc admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:53.663704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:53.682437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9fcf3a-433f-46be-bb5c-13373513ccdc admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:53.699625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ef7d4-3c64-49ea-b9be-432148c1b7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:53.707749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ef7d4-3c64-49ea-b9be-432148c1b7c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:53.714511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ef7d4-3c64-49ea-b9be-432148c1b7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:53.714973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ef7d4-3c64-49ea-b9be-432148c1b7c9 admin admin] PATH_INFO: `/v3/projects/363056372dc24ec4bffccf02e52a21c0/users/d5245d13a47742d7abc52e8429eb1c52/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:53.775679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ef7d4-3c64-49ea-b9be-432148c1b7c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363056372dc24ec4bffccf02e52a21c0, user_id=d5245d13a47742d7abc52e8429eb1c52, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:53.782928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41ef7d4-3c64-49ea-b9be-432148c1b7c9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:53.937073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5237b3b97634d7ea235040957b45aa5', 'request_id': 'req-c2084a4d-4c87-48f9-86f8-5a30a4428e45'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:53.946885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 871/1722] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:53 2022] PUT /identity/v3/projects/363056372dc24ec4bffccf02e52a21c0/users/d5245d13a47742d7abc52e8429eb1c52/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:53.951667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5237b3b97634d7ea235040957b45aa5', 'request_id': 'req-c2084a4d-4c87-48f9-86f8-5a30a4428e45'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:53.954931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ef7d4-3c64-49ea-b9be-432148c1b7c9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:53.966283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5237b3b97634d7ea235040957b45aa5', 'request_id': 'req-c2084a4d-4c87-48f9-86f8-5a30a4428e45'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:54.106002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ef7d4-3c64-49ea-b9be-432148c1b7c9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:54.114199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130455fd-30b4-4ded-99ad-c69993258f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:54.114465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] The token cache is being invalidate because project d5237b3b97634d7ea235040957b45aa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:36:54.114764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:54.115395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130455fd-30b4-4ded-99ad-c69993258f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:54.115609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:54.115986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130455fd-30b4-4ded-99ad-c69993258f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:54.116398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130455fd-30b4-4ded-99ad-c69993258f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:54.117287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130455fd-30b4-4ded-99ad-c69993258f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:54.119327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 852/1723] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:36:53 2022] DELETE /identity/v3/projects/d5237b3b97634d7ea235040957b45aa5 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:54.123127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:54.126441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:54.135908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130455fd-30b4-4ded-99ad-c69993258f08 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:54.148419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 872/1724] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:54.158404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130455fd-30b4-4ded-99ad-c69993258f08 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:54.160386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-130455fd-30b4-4ded-99ad-c69993258f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:54.175215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130455fd-30b4-4ded-99ad-c69993258f08 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:54.182095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881fb09-2c43-4e60-a0cc-14145a8d5146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:54.183261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881fb09-2c43-4e60-a0cc-14145a8d5146 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:54.183705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881fb09-2c43-4e60-a0cc-14145a8d5146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:54.184274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881fb09-2c43-4e60-a0cc-14145a8d5146 admin admin] PATH_INFO: `/v3/projects/363056372dc24ec4bffccf02e52a21c0/users/d5245d13a47742d7abc52e8429eb1c52/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:54.187812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881fb09-2c43-4e60-a0cc-14145a8d5146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=363056372dc24ec4bffccf02e52a21c0, user_id=d5245d13a47742d7abc52e8429eb1c52, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:54.190762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881fb09-2c43-4e60-a0cc-14145a8d5146 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:54.218860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 873/1725] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:54 2022] PUT /identity/v3/projects/363056372dc24ec4bffccf02e52a21c0/users/d5245d13a47742d7abc52e8429eb1c52/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:54.229882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28574a-c7f7-4f37-ba99-984ddeda8e81 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:54.230506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28574a-c7f7-4f37-ba99-984ddeda8e81 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:54.231267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be28574a-c7f7-4f37-ba99-984ddeda8e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:54.278322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-be28574a-c7f7-4f37-ba99-984ddeda8e81 None None] MFA Rules not processed for user `d5245d13a47742d7abc52e8429eb1c52`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:54.284814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-be28574a-c7f7-4f37-ba99-984ddeda8e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:54.290943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2084a4d-4c87-48f9-86f8-5a30a4428e45 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:54.361164 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:54.433404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:54.435441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:54.436236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:54.436689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] PATH_INFO: `/v3/users/75508971115340b7a0a3debd9b18f4e4` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:54.439594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75508971115340b7a0a3debd9b18f4e4)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:54.442766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:54.515236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 874/1726] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:54 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:36:54.516341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28574a-c7f7-4f37-ba99-984ddeda8e81 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:54.518063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-be28574a-c7f7-4f37-ba99-984ddeda8e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:54.603775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be28574a-c7f7-4f37-ba99-984ddeda8e81 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:54.608327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe701-7f94-48b8-8bbf-51136a4120c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:54.609846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe701-7f94-48b8-8bbf-51136a4120c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:54.610446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe701-7f94-48b8-8bbf-51136a4120c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:54.610909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705fe701-7f94-48b8-8bbf-51136a4120c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:54.626831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe701-7f94-48b8-8bbf-51136a4120c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:54.628471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705fe701-7f94-48b8-8bbf-51136a4120c7 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:54.657793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 875/1727] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:54 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:54.811139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75508971115340b7a0a3debd9b18f4e4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:54.837110 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75508971115340b7a0a3debd9b18f4e4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:54.846949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75508971115340b7a0a3debd9b18f4e4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:54.897732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75508971115340b7a0a3debd9b18f4e4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:54.902079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe701-7f94-48b8-8bbf-51136a4120c7 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:54.904213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-705fe701-7f94-48b8-8bbf-51136a4120c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:54.911684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75508971115340b7a0a3debd9b18f4e4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:54.934122 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705fe701-7f94-48b8-8bbf-51136a4120c7 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:54.939607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:54.940730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:54.941123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:54.941719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] PATH_INFO: `/v3/projects/8a1fed5f2a894c4eb248b9fdef2a9b62` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:54.942987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1fed5f2a894c4eb248b9fdef2a9b62)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:54.944901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:55.052742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:55.059819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 853/1728] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:36:54 2022] DELETE /identity/v3/users/75508971115340b7a0a3debd9b18f4e4 => generated 0 bytes in 937 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:55.060811 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:55.062617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:55.120049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1fed5f2a894c4eb248b9fdef2a9b62', 'request_id': 'req-27142175-67e8-477d-a2e3-6e84f328f36d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:55.134693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1fed5f2a894c4eb248b9fdef2a9b62', 'request_id': 'req-27142175-67e8-477d-a2e3-6e84f328f36d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:55.143258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1fed5f2a894c4eb248b9fdef2a9b62', 'request_id': 'req-27142175-67e8-477d-a2e3-6e84f328f36d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:55.250874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] The token cache is being invalidate because project 8a1fed5f2a894c4eb248b9fdef2a9b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:36:55.252623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:55.252623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-27142175-67e8-477d-a2e3-6e84f328f36d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:55.258986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 876/1729] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:36:54 2022] DELETE /identity/v3/projects/8a1fed5f2a894c4eb248b9fdef2a9b62 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:36:55.264797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acc273-15fc-4a00-ac16-5e79ca328c35 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:55.266550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acc273-15fc-4a00-ac16-5e79ca328c35 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:55.266894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acc273-15fc-4a00-ac16-5e79ca328c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:55.307408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab898b7a-8515-410b-af94-c06b6bb11a86 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:55.365148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-07acc273-15fc-4a00-ac16-5e79ca328c35 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:55.367501 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-07acc273-15fc-4a00-ac16-5e79ca328c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:55.456948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9a97-a14c-44f9-b11a-f143ab9453da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:55.457753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9a97-a14c-44f9-b11a-f143ab9453da service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:55.458135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9a97-a14c-44f9-b11a-f143ab9453da service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:55.458543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb9a97-a14c-44f9-b11a-f143ab9453da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:55.461136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7feb9a97-a14c-44f9-b11a-f143ab9453da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:55.553262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 877/1730] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:55.560758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e7311-ebd3-424c-aed0-b0394ee4bb1d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:55.561184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e7311-ebd3-424c-aed0-b0394ee4bb1d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:55.562500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119e7311-ebd3-424c-aed0-b0394ee4bb1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:55.610993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-119e7311-ebd3-424c-aed0-b0394ee4bb1d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:55.618628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb9a97-a14c-44f9-b11a-f143ab9453da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:55.620881 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb9a97-a14c-44f9-b11a-f143ab9453da service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:55.630616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-119e7311-ebd3-424c-aed0-b0394ee4bb1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:55.642481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 854/1731] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:36:55 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:36:55.650410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 878/1732] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:36:55.650543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9a97-a14c-44f9-b11a-f143ab9453da service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:55.666154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb9a97-a14c-44f9-b11a-f143ab9453da service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:55.680675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04f599-9838-4ac9-ba6f-75a74668ac35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:55.681373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04f599-9838-4ac9-ba6f-75a74668ac35 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:55.681716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04f599-9838-4ac9-ba6f-75a74668ac35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:55.681994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f04f599-9838-4ac9-ba6f-75a74668ac35 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:55.682806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04f599-9838-4ac9-ba6f-75a74668ac35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:36:55.683115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04f599-9838-4ac9-ba6f-75a74668ac35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:55.684768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f04f599-9838-4ac9-ba6f-75a74668ac35 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:55.703919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 855/1733] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:36:55.706308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e7311-ebd3-424c-aed0-b0394ee4bb1d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:55.722713 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119e7311-ebd3-424c-aed0-b0394ee4bb1d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:55.747844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e01cea-10cc-4162-8e93-6a8867015ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:55.758154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01cea-10cc-4162-8e93-6a8867015ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:55.758731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01cea-10cc-4162-8e93-6a8867015ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:55.759176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e01cea-10cc-4162-8e93-6a8867015ca7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:55.763832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e01cea-10cc-4162-8e93-6a8867015ca7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:55.763832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e01cea-10cc-4162-8e93-6a8867015ca7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:55.976177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 879/1734] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:55 2022] POST /identity/v3/projects => generated 385 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:55.979858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04f599-9838-4ac9-ba6f-75a74668ac35 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:55.998195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f04f599-9838-4ac9-ba6f-75a74668ac35 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:56.174461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a224162-7c0f-49a9-8cb8-b470e68db085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:56.175929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a224162-7c0f-49a9-8cb8-b470e68db085 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:56.176359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a224162-7c0f-49a9-8cb8-b470e68db085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:56.177344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a224162-7c0f-49a9-8cb8-b470e68db085 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:56.178552 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a224162-7c0f-49a9-8cb8-b470e68db085 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:56.180895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a224162-7c0f-49a9-8cb8-b470e68db085 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:56.291390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231009-2f60-4c2a-beca-5a6f6770cca0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:56.292029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231009-2f60-4c2a-beca-5a6f6770cca0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:56.292029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54231009-2f60-4c2a-beca-5a6f6770cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:56.319212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 856/1735] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:55 2022] POST /identity/v3/users => generated 293 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:36:56.320971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a224162-7c0f-49a9-8cb8-b470e68db085 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:56.351392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-54231009-2f60-4c2a-beca-5a6f6770cca0 None None] MFA Rules not processed for user `28d83ef95cda448dbd72acbd13a5f008`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:56.359479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-54231009-2f60-4c2a-beca-5a6f6770cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:56.362463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a224162-7c0f-49a9-8cb8-b470e68db085 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:56.381408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2405e-62a5-4945-b5ab-e81f732a828a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:56.382297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2405e-62a5-4945-b5ab-e81f732a828a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:56.383009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2405e-62a5-4945-b5ab-e81f732a828a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:56.383349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2405e-62a5-4945-b5ab-e81f732a828a admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:56.384094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2405e-62a5-4945-b5ab-e81f732a828a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:56.387958 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba2405e-62a5-4945-b5ab-e81f732a828a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:56.419508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 857/1736] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:56.420634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2405e-62a5-4945-b5ab-e81f732a828a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:56.455658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2405e-62a5-4945-b5ab-e81f732a828a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:56.472376 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c415-64fb-44db-97bb-f777c468ec21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:56.473125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c415-64fb-44db-97bb-f777c468ec21 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:56.477269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c415-64fb-44db-97bb-f777c468ec21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:56.477600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87c415-64fb-44db-97bb-f777c468ec21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:56.478787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87c415-64fb-44db-97bb-f777c468ec21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:56.486140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87c415-64fb-44db-97bb-f777c468ec21 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:56.516963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 858/1737] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:56.520989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c415-64fb-44db-97bb-f777c468ec21 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:56.549495 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87c415-64fb-44db-97bb-f777c468ec21 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:56.563516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455df539-51ad-410b-aae0-9bf8e4cf1c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:56.564404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455df539-51ad-410b-aae0-9bf8e4cf1c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:56.564723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455df539-51ad-410b-aae0-9bf8e4cf1c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:56.565000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455df539-51ad-410b-aae0-9bf8e4cf1c1a admin admin] PATH_INFO: `/v3/projects/e060462807db4929a77dfa5236447914/users/36b58ded0bf4408c9770a96a4a899e70/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:56.590567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 880/1738] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:56.629725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455df539-51ad-410b-aae0-9bf8e4cf1c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e060462807db4929a77dfa5236447914, user_id=36b58ded0bf4408c9770a96a4a899e70, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:56.641657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455df539-51ad-410b-aae0-9bf8e4cf1c1a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:56.760505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 859/1739] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:56 2022] PUT /identity/v3/projects/e060462807db4929a77dfa5236447914/users/36b58ded0bf4408c9770a96a4a899e70/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:56.778527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758f8d4-7f32-4b9a-b8a1-e6a16e065ed0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:56.779662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758f8d4-7f32-4b9a-b8a1-e6a16e065ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:56.780153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758f8d4-7f32-4b9a-b8a1-e6a16e065ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:56.869130 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8758f8d4-7f32-4b9a-b8a1-e6a16e065ed0 None None] MFA Rules not processed for user `36b58ded0bf4408c9770a96a4a899e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:56.876412 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8758f8d4-7f32-4b9a-b8a1-e6a16e065ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:57.162927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 881/1740] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:57.168158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455df539-51ad-410b-aae0-9bf8e4cf1c1a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:57.241819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86231e-5589-4d16-86f9-d8fb02dff133 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:57.243485 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86231e-5589-4d16-86f9-d8fb02dff133 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:57.243992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc86231e-5589-4d16-86f9-d8fb02dff133 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:57.245737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 882/1741] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:36:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:36:57.276191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a62b3-ab61-4b10-846c-2e14c2f54abf None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:57.278829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a62b3-ab61-4b10-846c-2e14c2f54abf None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:57.281088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0a62b3-ab61-4b10-846c-2e14c2f54abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:57.307690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:57.370809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6f0a62b3-ab61-4b10-846c-2e14c2f54abf None None] MFA Rules not processed for user `0487ea9076ee4baf8138fdc25ce02522`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:57.372604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6f0a62b3-ab61-4b10-846c-2e14c2f54abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:57.390243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455df539-51ad-410b-aae0-9bf8e4cf1c1a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:57.395812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc36af32-b050-4d0b-bc1c-24560375ac09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:57.396534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36af32-b050-4d0b-bc1c-24560375ac09 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:57.396853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36af32-b050-4d0b-bc1c-24560375ac09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:57.397127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc36af32-b050-4d0b-bc1c-24560375ac09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:57.397828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36af32-b050-4d0b-bc1c-24560375ac09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:57.399734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc36af32-b050-4d0b-bc1c-24560375ac09 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:57.533465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 860/1742] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:57 2022] POST /identity/v3/projects => generated 387 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:57.537804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0e9a-f62a-48c1-9f28-782101b8fe9a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:57.538091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0e9a-f62a-48c1-9f28-782101b8fe9a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:57.538364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a0e9a-f62a-48c1-9f28-782101b8fe9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:57.613636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ec6a0e9a-f62a-48c1-9f28-782101b8fe9a None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:57.614936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ec6a0e9a-f62a-48c1-9f28-782101b8fe9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:57.623256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:57.629690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 883/1743] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:57.629690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a62b3-ab61-4b10-846c-2e14c2f54abf None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:57.658175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0a62b3-ab61-4b10-846c-2e14c2f54abf None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:57.850884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a787a78-97bd-4bf8-89e8-4faff0a1f621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:57.854545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a787a78-97bd-4bf8-89e8-4faff0a1f621 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:57.854545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a787a78-97bd-4bf8-89e8-4faff0a1f621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:57.854545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a787a78-97bd-4bf8-89e8-4faff0a1f621 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:57.854545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a787a78-97bd-4bf8-89e8-4faff0a1f621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:57.866499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a787a78-97bd-4bf8-89e8-4faff0a1f621 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:57.879531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 861/1744] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:36:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:58.019725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 884/1745] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:57 2022] POST /identity/v3/users => generated 294 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:58.021309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a0e9a-f62a-48c1-9f28-782101b8fe9a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:58.036395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a0e9a-f62a-48c1-9f28-782101b8fe9a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:58.068995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b66d5-472d-49f8-a264-b6837f45aec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:58.070030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b66d5-472d-49f8-a264-b6837f45aec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:58.070465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b66d5-472d-49f8-a264-b6837f45aec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:58.070924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b66d5-472d-49f8-a264-b6837f45aec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:58.072001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b66d5-472d-49f8-a264-b6837f45aec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:58.074001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41b66d5-472d-49f8-a264-b6837f45aec9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:58.097181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 862/1746] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:58.103757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a787a78-97bd-4bf8-89e8-4faff0a1f621 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:58.121600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a787a78-97bd-4bf8-89e8-4faff0a1f621 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:58.132077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943a0df-808f-4059-9c26-d830df11a606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:58.132077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943a0df-808f-4059-9c26-d830df11a606 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:58.132077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943a0df-808f-4059-9c26-d830df11a606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:58.132077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943a0df-808f-4059-9c26-d830df11a606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:58.132456 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943a0df-808f-4059-9c26-d830df11a606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:58.135255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c943a0df-808f-4059-9c26-d830df11a606 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:58.171169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 885/1747] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:58 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:58.172200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b66d5-472d-49f8-a264-b6837f45aec9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:58.193818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b66d5-472d-49f8-a264-b6837f45aec9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:58.205020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410afe5-a98f-4645-9f52-bbe9f1c58720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:58.205957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410afe5-a98f-4645-9f52-bbe9f1c58720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:58.206236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410afe5-a98f-4645-9f52-bbe9f1c58720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:58.211742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7410afe5-a98f-4645-9f52-bbe9f1c58720 admin admin] PATH_INFO: `/v3/projects/f344adc209144055b19cd20fc11a36b8/users/760e3e14e2b845179f55e10bc331a6b6/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:58.239687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410afe5-a98f-4645-9f52-bbe9f1c58720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f344adc209144055b19cd20fc11a36b8, user_id=760e3e14e2b845179f55e10bc331a6b6, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:58.249379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7410afe5-a98f-4645-9f52-bbe9f1c58720 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:58.328841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 863/1748] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:58 2022] PUT /identity/v3/projects/f344adc209144055b19cd20fc11a36b8/users/760e3e14e2b845179f55e10bc331a6b6/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:58.339489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51719-e78f-4235-9816-237593ffd09d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:58.339953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51719-e78f-4235-9816-237593ffd09d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:58.340063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f51719-e78f-4235-9816-237593ffd09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:58.406051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-29f51719-e78f-4235-9816-237593ffd09d None None] MFA Rules not processed for user `760e3e14e2b845179f55e10bc331a6b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:58.407733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-29f51719-e78f-4235-9816-237593ffd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:58.553554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410afe5-a98f-4645-9f52-bbe9f1c58720 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:58.554597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 886/1749] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:58.646336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51719-e78f-4235-9816-237593ffd09d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:58.648940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-29f51719-e78f-4235-9816-237593ffd09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:58.694321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7410afe5-a98f-4645-9f52-bbe9f1c58720 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:58.714310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a80fb5-e4e1-490c-a5ae-bcb689e4d127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:58.715789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a80fb5-e4e1-490c-a5ae-bcb689e4d127 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:58.717613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a80fb5-e4e1-490c-a5ae-bcb689e4d127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:58.721490 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a80fb5-e4e1-490c-a5ae-bcb689e4d127 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:58.726655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a80fb5-e4e1-490c-a5ae-bcb689e4d127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:58.729703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a80fb5-e4e1-490c-a5ae-bcb689e4d127 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:58.736421 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:58.905115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f51719-e78f-4235-9816-237593ffd09d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:58.907872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 864/1750] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:36:58 2022] POST /identity/v3/projects => generated 387 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:36:58.911744 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a80fb5-e4e1-490c-a5ae-bcb689e4d127 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:59.118076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:59.119501 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:59.120834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:59.121481 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] PATH_INFO: `/v3/projects/58eebff618e045cc86d90cdf1f0553e1` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:59.127351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58eebff618e045cc86d90cdf1f0553e1)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:59.132598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a80fb5-e4e1-490c-a5ae-bcb689e4d127 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:59.135072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:59.148656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3030401e-9248-4401-9dc7-3aabd3a79e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:59.151530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030401e-9248-4401-9dc7-3aabd3a79e39 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:59.151530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030401e-9248-4401-9dc7-3aabd3a79e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:59.151530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3030401e-9248-4401-9dc7-3aabd3a79e39 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:59.151530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030401e-9248-4401-9dc7-3aabd3a79e39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:59.161980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3030401e-9248-4401-9dc7-3aabd3a79e39 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:59.309510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 865/1751] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:36:58 2022] POST /identity/v3/users => generated 300 bytes in 398 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:36:59.314303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a67fc2-2cb5-4050-814a-cf607a5c0e26 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:59.316406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a67fc2-2cb5-4050-814a-cf607a5c0e26 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:59.319636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a67fc2-2cb5-4050-814a-cf607a5c0e26 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:59.329654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 866/1752] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:36:59 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:36:59.336772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7377-fa6b-47a0-b2bc-1297fc5cc20b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:59.344220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7377-fa6b-47a0-b2bc-1297fc5cc20b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:59.345370 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ee7377-fa6b-47a0-b2bc-1297fc5cc20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:59.351091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58eebff618e045cc86d90cdf1f0553e1', 'request_id': 'req-cb9fda43-3008-490d-96d5-1ab313e8edb6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:59.380700 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58eebff618e045cc86d90cdf1f0553e1', 'request_id': 'req-cb9fda43-3008-490d-96d5-1ab313e8edb6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:59.405329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58eebff618e045cc86d90cdf1f0553e1', 'request_id': 'req-cb9fda43-3008-490d-96d5-1ab313e8edb6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:59.424130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-94ee7377-fa6b-47a0-b2bc-1297fc5cc20b None None] MFA Rules not processed for user `18eb8b615526451498d3adc382d5a410`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:59.426403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-94ee7377-fa6b-47a0-b2bc-1297fc5cc20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:59.521810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] The token cache is being invalidate because project 58eebff618e045cc86d90cdf1f0553e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:36:59.521810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:59.522156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:36:59.525891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 887/1753] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:36:58 2022] DELETE /identity/v3/projects/58eebff618e045cc86d90cdf1f0553e1 => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:36:59.531171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:59.543418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:59.650874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:59.658770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 867/1754] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:59.660736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c92b8c-947e-426c-a061-2049751d01f2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:59.661003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c92b8c-947e-426c-a061-2049751d01f2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:59.661510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c92b8c-947e-426c-a061-2049751d01f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:59.704947 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a9c92b8c-947e-426c-a061-2049751d01f2 None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:59.706754 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a9c92b8c-947e-426c-a061-2049751d01f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:59.800775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fda43-3008-490d-96d5-1ab313e8edb6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:59.821690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cb149-b568-4f8c-86dc-893aea9ce4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:59.822533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cb149-b568-4f8c-86dc-893aea9ce4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:59.822828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cb149-b568-4f8c-86dc-893aea9ce4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:59.823155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cb149-b568-4f8c-86dc-893aea9ce4c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:59.824765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cb149-b568-4f8c-86dc-893aea9ce4c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:36:59.829525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cb149-b568-4f8c-86dc-893aea9ce4c0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:36:59.864323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 888/1755] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:36:59.864627 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 868/1756] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:36:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:59.867929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490db53-5f63-483c-bdb1-083444ce11ae None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:59.868225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490db53-5f63-483c-bdb1-083444ce11ae None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:59.869014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4490db53-5f63-483c-bdb1-083444ce11ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:59.878696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c92b8c-947e-426c-a061-2049751d01f2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:36:59.926042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4490db53-5f63-483c-bdb1-083444ce11ae None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:36:59.938645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4490db53-5f63-483c-bdb1-083444ce11ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:36:59.955571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c92b8c-947e-426c-a061-2049751d01f2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:36:59.958845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 889/1757] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:36:59.966962 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd3fb6-56ec-4379-bffd-be043ce69986 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:36:59.967423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd3fb6-56ec-4379-bffd-be043ce69986 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:36:59.967796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd3fb6-56ec-4379-bffd-be043ce69986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:36:59.992830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dbed3-5e20-4af5-9846-ebef721945ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:36:59.993900 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dbed3-5e20-4af5-9846-ebef721945ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:00.001074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dbed3-5e20-4af5-9846-ebef721945ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:00.002013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896dbed3-5e20-4af5-9846-ebef721945ec admin admin] PATH_INFO: `/v3/projects/23af2ee4f4de488783be99a38e051ec2/users/757d34984533455ab9d859b515907123/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:00.006659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-96fd3fb6-56ec-4379-bffd-be043ce69986 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:00.008921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-96fd3fb6-56ec-4379-bffd-be043ce69986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:00.030918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 890/1758] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:00.036686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd3fb6-56ec-4379-bffd-be043ce69986 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:00.054638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd3fb6-56ec-4379-bffd-be043ce69986 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:00.058039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896dbed3-5e20-4af5-9846-ebef721945ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=23af2ee4f4de488783be99a38e051ec2, user_id=757d34984533455ab9d859b515907123, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:00.066359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896dbed3-5e20-4af5-9846-ebef721945ec admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:00.075967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e09450-c7fc-441d-b33b-9c535514a9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:00.081065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e09450-c7fc-441d-b33b-9c535514a9ef admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:00.082097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e09450-c7fc-441d-b33b-9c535514a9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:00.084130 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e09450-c7fc-441d-b33b-9c535514a9ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:00.085704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e09450-c7fc-441d-b33b-9c535514a9ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:00.087764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e09450-c7fc-441d-b33b-9c535514a9ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:00.095684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e09450-c7fc-441d-b33b-9c535514a9ef admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:00.133825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 891/1759] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:00.138192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e09450-c7fc-441d-b33b-9c535514a9ef admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:00.163493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e09450-c7fc-441d-b33b-9c535514a9ef admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:00.184080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 869/1760] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:36:59 2022] PUT /identity/v3/projects/23af2ee4f4de488783be99a38e051ec2/users/757d34984533455ab9d859b515907123/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:00.189520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f2971-05a3-4622-b163-60c7e14219af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:00.190023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dbed3-5e20-4af5-9846-ebef721945ec admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:00.190667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2971-05a3-4622-b163-60c7e14219af admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:00.190667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2971-05a3-4622-b163-60c7e14219af admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:00.197392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f2971-05a3-4622-b163-60c7e14219af admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:00.197392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f2971-05a3-4622-b163-60c7e14219af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:00.197392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f2971-05a3-4622-b163-60c7e14219af admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:00.373332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 892/1761] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:00 2022] POST /identity/v3/projects => generated 367 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:00.374151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896dbed3-5e20-4af5-9846-ebef721945ec admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:00.378234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f2971-05a3-4622-b163-60c7e14219af admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:00.555144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f2971-05a3-4622-b163-60c7e14219af admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:00.569939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1f16-6f63-4b3e-88fb-e70aa11e6027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:00.570674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f16-6f63-4b3e-88fb-e70aa11e6027 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:00.571004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f16-6f63-4b3e-88fb-e70aa11e6027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:00.571285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb1f16-6f63-4b3e-88fb-e70aa11e6027 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:00.575744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1f16-6f63-4b3e-88fb-e70aa11e6027 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:00.581723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb1f16-6f63-4b3e-88fb-e70aa11e6027 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:00.743463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170b275-a014-410d-a0f8-3b828f852d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:00.743463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170b275-a014-410d-a0f8-3b828f852d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:00.743463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170b275-a014-410d-a0f8-3b828f852d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:00.743463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170b275-a014-410d-a0f8-3b828f852d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:00.745787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170b275-a014-410d-a0f8-3b828f852d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:00.745787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4170b275-a014-410d-a0f8-3b828f852d07 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:00.745787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 870/1762] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 513 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:00.745787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170b275-a014-410d-a0f8-3b828f852d07 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:00.745787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4170b275-a014-410d-a0f8-3b828f852d07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:00.836325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4170b275-a014-410d-a0f8-3b828f852d07 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:00.849350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4258d83-f168-41fa-8344-cc1828e577d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:00.851148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4258d83-f168-41fa-8344-cc1828e577d1 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:00.852009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4258d83-f168-41fa-8344-cc1828e577d1 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:00.852312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4258d83-f168-41fa-8344-cc1828e577d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:00.855354 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e4258d83-f168-41fa-8344-cc1828e577d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:00.885845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4258d83-f168-41fa-8344-cc1828e577d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:00.890672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4258d83-f168-41fa-8344-cc1828e577d1 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:00.925997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 871/1763] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:00.947116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4258d83-f168-41fa-8344-cc1828e577d1 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:01.023524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4258d83-f168-41fa-8344-cc1828e577d1 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:01.063048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84b28eb-e693-41f3-ad6b-5858c07e1902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:01.066787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b28eb-e693-41f3-ad6b-5858c07e1902 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:01.067072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b28eb-e693-41f3-ad6b-5858c07e1902 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:01.067350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84b28eb-e693-41f3-ad6b-5858c07e1902 admin admin] PATH_INFO: `/v3/projects/23af2ee4f4de488783be99a38e051ec2/users/757d34984533455ab9d859b515907123/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:01.082533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b28eb-e693-41f3-ad6b-5858c07e1902 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23af2ee4f4de488783be99a38e051ec2, user_id=757d34984533455ab9d859b515907123, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:01.085430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84b28eb-e693-41f3-ad6b-5858c07e1902 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:01.099934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 872/1764] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:00 2022] PUT /identity/v3/projects/23af2ee4f4de488783be99a38e051ec2/users/757d34984533455ab9d859b515907123/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:01.111012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbec5c-4f05-4347-a9d0-eb8e635d4325 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:01.111643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbec5c-4f05-4347-a9d0-eb8e635d4325 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:01.112131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dbec5c-4f05-4347-a9d0-eb8e635d4325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:01.143740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 893/1765] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:00 2022] POST /identity/v3/users => generated 284 bytes in 766 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:01.157152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1f16-6f63-4b3e-88fb-e70aa11e6027 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:01.172694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-48dbec5c-4f05-4347-a9d0-eb8e635d4325 None None] MFA Rules not processed for user `757d34984533455ab9d859b515907123`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:01.173947 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-48dbec5c-4f05-4347-a9d0-eb8e635d4325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:01.184658 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb1f16-6f63-4b3e-88fb-e70aa11e6027 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:01.185781 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:01.352315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 873/1766] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:01.352315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbec5c-4f05-4347-a9d0-eb8e635d4325 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:01.352315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-48dbec5c-4f05-4347-a9d0-eb8e635d4325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:01.379721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cc8d9-fbae-4db7-a3f6-57a49b0a9592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:01.381437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cc8d9-fbae-4db7-a3f6-57a49b0a9592 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:01.382183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cc8d9-fbae-4db7-a3f6-57a49b0a9592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:01.382836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437cc8d9-fbae-4db7-a3f6-57a49b0a9592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:01.383832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cc8d9-fbae-4db7-a3f6-57a49b0a9592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:01.386814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437cc8d9-fbae-4db7-a3f6-57a49b0a9592 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:01.411568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 894/1767] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:01.416925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cc8d9-fbae-4db7-a3f6-57a49b0a9592 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:01.443275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437cc8d9-fbae-4db7-a3f6-57a49b0a9592 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:01.457934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f322ee-86fd-4e60-8e1e-299d8bd72ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:01.459070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f322ee-86fd-4e60-8e1e-299d8bd72ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:01.459554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f322ee-86fd-4e60-8e1e-299d8bd72ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:01.459993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f322ee-86fd-4e60-8e1e-299d8bd72ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:01.461058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f322ee-86fd-4e60-8e1e-299d8bd72ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:01.462869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f322ee-86fd-4e60-8e1e-299d8bd72ec1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:01.463143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dbec5c-4f05-4347-a9d0-eb8e635d4325 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:01.482472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cf4181-5a15-4981-93f5-fcd4ea9d7f9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:01.482472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf4181-5a15-4981-93f5-fcd4ea9d7f9f service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:01.482472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf4181-5a15-4981-93f5-fcd4ea9d7f9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:01.482472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cf4181-5a15-4981-93f5-fcd4ea9d7f9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:01.495596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 895/1768] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:01.500984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f322ee-86fd-4e60-8e1e-299d8bd72ec1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:01.510309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf4181-5a15-4981-93f5-fcd4ea9d7f9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:01.512332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cf4181-5a15-4981-93f5-fcd4ea9d7f9f service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:01.523137 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f322ee-86fd-4e60-8e1e-299d8bd72ec1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:01.540457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 874/1769] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:01.542140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd731b-6c2f-4764-a299-1d33043b918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:01.544004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd731b-6c2f-4764-a299-1d33043b918d admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:01.544463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd731b-6c2f-4764-a299-1d33043b918d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:01.544937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfd731b-6c2f-4764-a299-1d33043b918d admin admin] PATH_INFO: `/v3/projects/a7c2e4a5768c4caaa4e6cc07423f97a8/users/dcd690f05f364d3db1e5a1d5af792bef/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:01.607587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd731b-6c2f-4764-a299-1d33043b918d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7c2e4a5768c4caaa4e6cc07423f97a8, user_id=dcd690f05f364d3db1e5a1d5af792bef, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:01.611310 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfd731b-6c2f-4764-a299-1d33043b918d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:01.720356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 896/1770] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:01 2022] PUT /identity/v3/projects/a7c2e4a5768c4caaa4e6cc07423f97a8/users/dcd690f05f364d3db1e5a1d5af792bef/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:01.731527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64871b7-0cec-4285-b82e-1749738459d1 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:01.732047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64871b7-0cec-4285-b82e-1749738459d1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:01.734342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64871b7-0cec-4285-b82e-1749738459d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:01.799098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b64871b7-0cec-4285-b82e-1749738459d1 None None] MFA Rules not processed for user `dcd690f05f364d3db1e5a1d5af792bef`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:01.804055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b64871b7-0cec-4285-b82e-1749738459d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:01.878242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd731b-6c2f-4764-a299-1d33043b918d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:01.944830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 875/1771] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:01 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:01.949896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64871b7-0cec-4285-b82e-1749738459d1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:02.011770 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfd731b-6c2f-4764-a299-1d33043b918d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:02.028892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d729f8-37a2-49b5-a338-a775846001b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:02.030073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d729f8-37a2-49b5-a338-a775846001b1 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:02.031368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d729f8-37a2-49b5-a338-a775846001b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:02.032316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d729f8-37a2-49b5-a338-a775846001b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:02.047142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d729f8-37a2-49b5-a338-a775846001b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:02.057420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d729f8-37a2-49b5-a338-a775846001b1 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:02.073944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:02.080982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 897/1772] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:02.131754 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64871b7-0cec-4285-b82e-1749738459d1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:02.151002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582d359-6c4c-415a-800e-8778c711d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:02.151812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582d359-6c4c-415a-800e-8778c711d481 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:02.151982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582d359-6c4c-415a-800e-8778c711d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:02.152268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582d359-6c4c-415a-800e-8778c711d481 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:02.153195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582d359-6c4c-415a-800e-8778c711d481 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:02.156668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582d359-6c4c-415a-800e-8778c711d481 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:02.302918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 876/1773] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:01 2022] POST /identity/v3/projects => generated 369 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:02.306654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d729f8-37a2-49b5-a338-a775846001b1 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:02.328230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d729f8-37a2-49b5-a338-a775846001b1 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:02.449240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c3a7-58e4-4e22-8b62-3590bb7d46ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:02.449978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c3a7-58e4-4e22-8b62-3590bb7d46ef admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:02.461196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c3a7-58e4-4e22-8b62-3590bb7d46ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:02.461815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a3c3a7-58e4-4e22-8b62-3590bb7d46ef admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:02.462730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c3a7-58e4-4e22-8b62-3590bb7d46ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:02.465104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a3c3a7-58e4-4e22-8b62-3590bb7d46ef admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:02.599435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 898/1774] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:02 2022] POST /identity/v3/users => generated 291 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:02.605316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582d359-6c4c-415a-800e-8778c711d481 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:02.618028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582d359-6c4c-415a-800e-8778c711d481 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:02.630438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137100a-0b21-4275-bd4c-501b6670aa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:02.631138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137100a-0b21-4275-bd4c-501b6670aa7c admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:02.631415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137100a-0b21-4275-bd4c-501b6670aa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:02.631679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137100a-0b21-4275-bd4c-501b6670aa7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:02.635462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137100a-0b21-4275-bd4c-501b6670aa7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:02.635462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137100a-0b21-4275-bd4c-501b6670aa7c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:02.648516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 877/1775] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:02.651680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c3a7-58e4-4e22-8b62-3590bb7d46ef admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:02.662539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a3c3a7-58e4-4e22-8b62-3590bb7d46ef admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:02.667239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51c73-34c1-4b3b-a604-872d58fa803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:02.668132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51c73-34c1-4b3b-a604-872d58fa803a admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:02.668414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51c73-34c1-4b3b-a604-872d58fa803a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:02.668742 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae51c73-34c1-4b3b-a604-872d58fa803a admin admin] PATH_INFO: `/v3/projects/fe20a5994e414c35b6a803a910a23e23/users/195c0401a7384b788a540354d40eb7bc/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:02.703734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51c73-34c1-4b3b-a604-872d58fa803a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe20a5994e414c35b6a803a910a23e23, user_id=195c0401a7384b788a540354d40eb7bc, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:02.706594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae51c73-34c1-4b3b-a604-872d58fa803a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:02.831553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 899/1776] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:02 2022] PUT /identity/v3/projects/fe20a5994e414c35b6a803a910a23e23/users/195c0401a7384b788a540354d40eb7bc/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:02.835097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137100a-0b21-4275-bd4c-501b6670aa7c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:02.845997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137100a-0b21-4275-bd4c-501b6670aa7c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:02.929188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5783ac5-ef12-4e68-87f3-0cb69e0f4561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:02.929872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5783ac5-ef12-4e68-87f3-0cb69e0f4561 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:02.930159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5783ac5-ef12-4e68-87f3-0cb69e0f4561 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:02.930437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5783ac5-ef12-4e68-87f3-0cb69e0f4561 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:02.931165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5783ac5-ef12-4e68-87f3-0cb69e0f4561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:02.932821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5783ac5-ef12-4e68-87f3-0cb69e0f4561 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:02.947540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 878/1777] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:37:02.948777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51c73-34c1-4b3b-a604-872d58fa803a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:02.959615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae51c73-34c1-4b3b-a604-872d58fa803a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:02.965415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bc23a-1b0a-4478-8d05-cb7ad17fe43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:02.966344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bc23a-1b0a-4478-8d05-cb7ad17fe43a admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:02.966621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bc23a-1b0a-4478-8d05-cb7ad17fe43a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:02.967125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6bc23a-1b0a-4478-8d05-cb7ad17fe43a admin admin] PATH_INFO: `/v3/projects/fe20a5994e414c35b6a803a910a23e23/users/195c0401a7384b788a540354d40eb7bc/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:02.969641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bc23a-1b0a-4478-8d05-cb7ad17fe43a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe20a5994e414c35b6a803a910a23e23, user_id=195c0401a7384b788a540354d40eb7bc, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:02.972343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6bc23a-1b0a-4478-8d05-cb7ad17fe43a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:02.988584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 900/1778] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:02 2022] PUT /identity/v3/projects/fe20a5994e414c35b6a803a910a23e23/users/195c0401a7384b788a540354d40eb7bc/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:02.997278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291666a-8818-4aa1-a34d-21d62379579b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:02.997599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291666a-8818-4aa1-a34d-21d62379579b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:02.997886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291666a-8818-4aa1-a34d-21d62379579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:03.031247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1291666a-8818-4aa1-a34d-21d62379579b None None] MFA Rules not processed for user `195c0401a7384b788a540354d40eb7bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:03.032776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1291666a-8818-4aa1-a34d-21d62379579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:03.102336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 879/1779] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:02 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:03.114934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bc23a-1b0a-4478-8d05-cb7ad17fe43a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:03.117028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bf6bc23a-1b0a-4478-8d05-cb7ad17fe43a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:03.176767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6bc23a-1b0a-4478-8d05-cb7ad17fe43a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:03.183257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb674f6-db10-4d36-9503-2b35e3cbeac8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:03.185971 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb674f6-db10-4d36-9503-2b35e3cbeac8 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:03.186275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb674f6-db10-4d36-9503-2b35e3cbeac8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:03.187002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb674f6-db10-4d36-9503-2b35e3cbeac8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:03.197448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb674f6-db10-4d36-9503-2b35e3cbeac8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:03.198897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb674f6-db10-4d36-9503-2b35e3cbeac8 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:03.209294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 901/1780] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:03 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:03.337211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291666a-8818-4aa1-a34d-21d62379579b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:03.349665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291666a-8818-4aa1-a34d-21d62379579b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:03.353739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f091f1-dff5-47e8-9275-7e60b36c8828 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:03.354413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f091f1-dff5-47e8-9275-7e60b36c8828 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:03.354798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f091f1-dff5-47e8-9275-7e60b36c8828 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:03.354961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f091f1-dff5-47e8-9275-7e60b36c8828 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:03.356963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e2f091f1-dff5-47e8-9275-7e60b36c8828 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:03.363153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb674f6-db10-4d36-9503-2b35e3cbeac8 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:03.372930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb674f6-db10-4d36-9503-2b35e3cbeac8 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:03.377583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c3933-db2a-471f-bdeb-ecf68b919364 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:03.378429 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c3933-db2a-471f-bdeb-ecf68b919364 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:03.378906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c3933-db2a-471f-bdeb-ecf68b919364 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:03.379278 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c3933-db2a-471f-bdeb-ecf68b919364 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:03.430015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f091f1-dff5-47e8-9275-7e60b36c8828 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:03.431804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f091f1-dff5-47e8-9275-7e60b36c8828 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:03.441705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 880/1781] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:03.446777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c3933-db2a-471f-bdeb-ecf68b919364 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:03.448117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c3933-db2a-471f-bdeb-ecf68b919364 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:03.459630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 902/1782] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:03 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:03.778011 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:05.010528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:07.352269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae068f-7d59-4132-953d-84f991865db1 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:07.353563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae068f-7d59-4132-953d-84f991865db1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:07.353843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae068f-7d59-4132-953d-84f991865db1 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:07.355240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 881/1783] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:37:07.376223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a8d74-bffa-4dcb-a27e-f4b43193852d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:07.377336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a8d74-bffa-4dcb-a27e-f4b43193852d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:07.377675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4a8d74-bffa-4dcb-a27e-f4b43193852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:07.399777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8f4a8d74-bffa-4dcb-a27e-f4b43193852d None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:07.401294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8f4a8d74-bffa-4dcb-a27e-f4b43193852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:07.496418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 903/1784] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:37:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:07.530888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae068f-7d59-4132-953d-84f991865db1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:07.533482 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8dae068f-7d59-4132-953d-84f991865db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:07.568309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae068f-7d59-4132-953d-84f991865db1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:07.586342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ca347-a04d-42fe-88c1-e71591d5f88b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:07.587047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ca347-a04d-42fe-88c1-e71591d5f88b service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:07.587328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ca347-a04d-42fe-88c1-e71591d5f88b service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:07.587791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ca347-a04d-42fe-88c1-e71591d5f88b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:07.612160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ca347-a04d-42fe-88c1-e71591d5f88b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:07.614694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07ca347-a04d-42fe-88c1-e71591d5f88b service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:07.630790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 882/1785] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:07.771663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:08.708148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:10.679997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:10.867791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:10.970143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a8d74-bffa-4dcb-a27e-f4b43193852d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:10.984161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4a8d74-bffa-4dcb-a27e-f4b43193852d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:10.993233 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31346587-e0bd-45f9-b176-7edcc87757b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:10.994572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31346587-e0bd-45f9-b176-7edcc87757b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:10.994991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31346587-e0bd-45f9-b176-7edcc87757b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:10.995391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31346587-e0bd-45f9-b176-7edcc87757b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:10.997774 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-31346587-e0bd-45f9-b176-7edcc87757b5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:11.087745 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31346587-e0bd-45f9-b176-7edcc87757b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:11.089688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31346587-e0bd-45f9-b176-7edcc87757b5 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:11.105733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 904/1786] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:11.438941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ca347-a04d-42fe-88c1-e71591d5f88b service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:11.654242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ca347-a04d-42fe-88c1-e71591d5f88b service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:11.659778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:11.672347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:11.673056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:11.674018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] PATH_INFO: `/v3/users/dcd690f05f364d3db1e5a1d5af792bef` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:11.675664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcd690f05f364d3db1e5a1d5af792bef)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:11.678208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:12.076311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcd690f05f364d3db1e5a1d5af792bef'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:12.088442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcd690f05f364d3db1e5a1d5af792bef'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:12.089497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcd690f05f364d3db1e5a1d5af792bef'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:12.103841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcd690f05f364d3db1e5a1d5af792bef'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:12.104722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcd690f05f364d3db1e5a1d5af792bef'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:12.387068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 883/1787] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:11 2022] DELETE /identity/v3/users/dcd690f05f364d3db1e5a1d5af792bef => generated 0 bytes in 951 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:12.392098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620cf1-11c2-4ee6-a00d-7e81fdf81152 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:12.392642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620cf1-11c2-4ee6-a00d-7e81fdf81152 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:12.392733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7620cf1-11c2-4ee6-a00d-7e81fdf81152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:12.409723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c7620cf1-11c2-4ee6-a00d-7e81fdf81152 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:12.410854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c7620cf1-11c2-4ee6-a00d-7e81fdf81152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:12.470378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 905/1788] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:12.481008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:12.482473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:12.543667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339b611-3d60-498c-9d4a-eb27bd7b6655 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:12.547858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33397e3c-2c0d-4711-bfae-0d9e3ae16855 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:12.548528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33397e3c-2c0d-4711-bfae-0d9e3ae16855 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:12.548819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33397e3c-2c0d-4711-bfae-0d9e3ae16855 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:12.549096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33397e3c-2c0d-4711-bfae-0d9e3ae16855 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:12.558280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33397e3c-2c0d-4711-bfae-0d9e3ae16855 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:12.559724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33397e3c-2c0d-4711-bfae-0d9e3ae16855 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:12.570311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 884/1789] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:13.451915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620cf1-11c2-4ee6-a00d-7e81fdf81152 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:13.454146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c7620cf1-11c2-4ee6-a00d-7e81fdf81152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:13.472843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7620cf1-11c2-4ee6-a00d-7e81fdf81152 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:13.482891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:13.484847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:13.485069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:13.485351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] PATH_INFO: `/v3/projects/a7c2e4a5768c4caaa4e6cc07423f97a8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:13.486646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7c2e4a5768c4caaa4e6cc07423f97a8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:13.488602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:13.666003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7c2e4a5768c4caaa4e6cc07423f97a8', 'request_id': 'req-64bcbefe-48bc-48ab-ae59-6244d437ea25'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:13.672230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7c2e4a5768c4caaa4e6cc07423f97a8', 'request_id': 'req-64bcbefe-48bc-48ab-ae59-6244d437ea25'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:13.673285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:13.677696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7c2e4a5768c4caaa4e6cc07423f97a8', 'request_id': 'req-64bcbefe-48bc-48ab-ae59-6244d437ea25'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:13.895103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] The token cache is being invalidate because project a7c2e4a5768c4caaa4e6cc07423f97a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:13.895469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:13.904065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:13.913287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 906/1790] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:13 2022] DELETE /identity/v3/projects/a7c2e4a5768c4caaa4e6cc07423f97a8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:13.917790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33397e3c-2c0d-4711-bfae-0d9e3ae16855 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:13.930411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33397e3c-2c0d-4711-bfae-0d9e3ae16855 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:14.015699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:14.015699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:14.015699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:14.016357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] PATH_INFO: `/v3/users/195c0401a7384b788a540354d40eb7bc` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:14.017819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=195c0401a7384b788a540354d40eb7bc)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:14.020318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:14.097144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:14.357551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '195c0401a7384b788a540354d40eb7bc'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:14.365300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '195c0401a7384b788a540354d40eb7bc'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:14.366002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '195c0401a7384b788a540354d40eb7bc'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:14.378144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '195c0401a7384b788a540354d40eb7bc'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:14.378820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4824ef25-40b8-40ed-b580-8ceb8d6eeb68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '195c0401a7384b788a540354d40eb7bc'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:14.479994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 885/1791] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:13 2022] DELETE /identity/v3/users/195c0401a7384b788a540354d40eb7bc => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:15.000797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:15.002226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:15.026999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcbefe-48bc-48ab-ae59-6244d437ea25 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:15.085805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:15.086673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:15.087092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:15.087404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] PATH_INFO: `/v3/projects/fe20a5994e414c35b6a803a910a23e23` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:15.088645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe20a5994e414c35b6a803a910a23e23)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:15.090552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:15.313043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe20a5994e414c35b6a803a910a23e23', 'request_id': 'req-0b1766ca-9998-46f9-9ef4-0def706f407c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:15.320365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe20a5994e414c35b6a803a910a23e23', 'request_id': 'req-0b1766ca-9998-46f9-9ef4-0def706f407c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:15.328220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe20a5994e414c35b6a803a910a23e23', 'request_id': 'req-0b1766ca-9998-46f9-9ef4-0def706f407c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:15.512823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] The token cache is being invalidate because project fe20a5994e414c35b6a803a910a23e23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:15.513039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:15.514086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0b1766ca-9998-46f9-9ef4-0def706f407c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:15.516120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 907/1792] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:14 2022] DELETE /identity/v3/projects/fe20a5994e414c35b6a803a910a23e23 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:15.521090 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881971-556e-4faf-b7d8-54cfc2ca5c46 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:15.521536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881971-556e-4faf-b7d8-54cfc2ca5c46 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:15.521840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc881971-556e-4faf-b7d8-54cfc2ca5c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:15.547333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-cc881971-556e-4faf-b7d8-54cfc2ca5c46 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:15.549604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cc881971-556e-4faf-b7d8-54cfc2ca5c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:15.676901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 886/1793] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:15.679018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f7125-14ef-477c-9a51-e4d41905021e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:15.679304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f7125-14ef-477c-9a51-e4d41905021e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:15.679581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6f7125-14ef-477c-9a51-e4d41905021e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:15.700031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cd6f7125-14ef-477c-9a51-e4d41905021e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:15.701349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cd6f7125-14ef-477c-9a51-e4d41905021e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:15.710582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 908/1794] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:15.714818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881971-556e-4faf-b7d8-54cfc2ca5c46 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:15.729988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc881971-556e-4faf-b7d8-54cfc2ca5c46 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:15.735668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674a4f4-d63f-4990-95a1-759f11fdfd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:15.736355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674a4f4-d63f-4990-95a1-759f11fdfd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:15.736725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674a4f4-d63f-4990-95a1-759f11fdfd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:15.737004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674a4f4-d63f-4990-95a1-759f11fdfd30 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:15.753382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674a4f4-d63f-4990-95a1-759f11fdfd30 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:15.753382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674a4f4-d63f-4990-95a1-759f11fdfd30 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:15.753382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674a4f4-d63f-4990-95a1-759f11fdfd30 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:15.753382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 887/1795] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:15.757022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f7125-14ef-477c-9a51-e4d41905021e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:15.766989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6f7125-14ef-477c-9a51-e4d41905021e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:15.771866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7b55b-8800-4768-982d-75084f3e0e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:15.772554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7b55b-8800-4768-982d-75084f3e0e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:15.772850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7b55b-8800-4768-982d-75084f3e0e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:15.773127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7b55b-8800-4768-982d-75084f3e0e0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:15.773991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7b55b-8800-4768-982d-75084f3e0e0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:15.775927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7b55b-8800-4768-982d-75084f3e0e0e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:15.894706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 909/1796] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:15 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:15.895839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674a4f4-d63f-4990-95a1-759f11fdfd30 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:15.906732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674a4f4-d63f-4990-95a1-759f11fdfd30 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:15.964577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d51fa5-cdc0-4ae3-be58-e3621947a2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:15.965250 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d51fa5-cdc0-4ae3-be58-e3621947a2cb admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:15.965532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d51fa5-cdc0-4ae3-be58-e3621947a2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:15.965808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d51fa5-cdc0-4ae3-be58-e3621947a2cb admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:15.966518 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d51fa5-cdc0-4ae3-be58-e3621947a2cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:15.969155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d51fa5-cdc0-4ae3-be58-e3621947a2cb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:16.113040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 888/1797] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:15 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:16.117202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7b55b-8800-4768-982d-75084f3e0e0e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:16.127441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7b55b-8800-4768-982d-75084f3e0e0e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:16.131956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116c01a-ef11-40e5-86d3-30d45f31af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:16.132654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116c01a-ef11-40e5-86d3-30d45f31af6c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:16.132935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116c01a-ef11-40e5-86d3-30d45f31af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:16.133208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d116c01a-ef11-40e5-86d3-30d45f31af6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:16.133932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116c01a-ef11-40e5-86d3-30d45f31af6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:16.135521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d116c01a-ef11-40e5-86d3-30d45f31af6c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:16.146480 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 910/1798] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:16.150442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d51fa5-cdc0-4ae3-be58-e3621947a2cb admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:16.161376 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d51fa5-cdc0-4ae3-be58-e3621947a2cb admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:16.166192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cc3db5-273a-46b3-b2f0-fac0a362de19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:16.166949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc3db5-273a-46b3-b2f0-fac0a362de19 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:16.167238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc3db5-273a-46b3-b2f0-fac0a362de19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:16.167557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cc3db5-273a-46b3-b2f0-fac0a362de19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:16.168467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc3db5-273a-46b3-b2f0-fac0a362de19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:16.170083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cc3db5-273a-46b3-b2f0-fac0a362de19 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:16.180293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 889/1799] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:16.184331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116c01a-ef11-40e5-86d3-30d45f31af6c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:16.194336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d116c01a-ef11-40e5-86d3-30d45f31af6c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:16.198827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b04838-bb1d-423f-ae18-57a5fd412cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:16.199741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b04838-bb1d-423f-ae18-57a5fd412cb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:16.200020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b04838-bb1d-423f-ae18-57a5fd412cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:16.200334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b04838-bb1d-423f-ae18-57a5fd412cb2 admin admin] PATH_INFO: `/v3/projects/d2486ebb1ba8473d8e554470db4df7f8/users/dcba04d525f54bbc945541e846725b44/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:16.215147 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b04838-bb1d-423f-ae18-57a5fd412cb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2486ebb1ba8473d8e554470db4df7f8, user_id=dcba04d525f54bbc945541e846725b44, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:16.219078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b04838-bb1d-423f-ae18-57a5fd412cb2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:16.372407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 911/1800] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:16 2022] PUT /identity/v3/projects/d2486ebb1ba8473d8e554470db4df7f8/users/dcba04d525f54bbc945541e846725b44/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:16.384955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10f512-aab0-4612-bfab-08fd572418f6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:16.385795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10f512-aab0-4612-bfab-08fd572418f6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:16.385795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d10f512-aab0-4612-bfab-08fd572418f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:16.446293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8d10f512-aab0-4612-bfab-08fd572418f6 None None] MFA Rules not processed for user `dcba04d525f54bbc945541e846725b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:16.447568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8d10f512-aab0-4612-bfab-08fd572418f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:16.547219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 890/1801] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:16.551951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b04838-bb1d-423f-ae18-57a5fd412cb2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:16.668622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b04838-bb1d-423f-ae18-57a5fd412cb2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:16.674804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549df97e-4ad8-4fde-ad79-3c024a482893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:16.675574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549df97e-4ad8-4fde-ad79-3c024a482893 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:16.675920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549df97e-4ad8-4fde-ad79-3c024a482893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:16.676261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549df97e-4ad8-4fde-ad79-3c024a482893 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:16.677258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549df97e-4ad8-4fde-ad79-3c024a482893 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:16.679258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549df97e-4ad8-4fde-ad79-3c024a482893 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:16.847820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 912/1802] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:16 2022] POST /identity/v3/projects => generated 381 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:16.852618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10f512-aab0-4612-bfab-08fd572418f6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:16.869984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d10f512-aab0-4612-bfab-08fd572418f6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:16.941623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420788e-aa87-409f-ba19-4c87c23c2759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:16.942683 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420788e-aa87-409f-ba19-4c87c23c2759 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:16.943131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420788e-aa87-409f-ba19-4c87c23c2759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:16.943657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420788e-aa87-409f-ba19-4c87c23c2759 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:16.948404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420788e-aa87-409f-ba19-4c87c23c2759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:16.948404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4420788e-aa87-409f-ba19-4c87c23c2759 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:17.062411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 891/1803] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:16 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:17.067295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549df97e-4ad8-4fde-ad79-3c024a482893 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:17.077722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549df97e-4ad8-4fde-ad79-3c024a482893 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:17.086727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b5b7c-25d3-4ba3-8c99-eee404670a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:17.088134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b5b7c-25d3-4ba3-8c99-eee404670a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:17.088765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b5b7c-25d3-4ba3-8c99-eee404670a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:17.089196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b5b7c-25d3-4ba3-8c99-eee404670a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:17.092016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b5b7c-25d3-4ba3-8c99-eee404670a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:17.094345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557b5b7c-25d3-4ba3-8c99-eee404670a77 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:17.113358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 913/1804] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:17.117373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420788e-aa87-409f-ba19-4c87c23c2759 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:17.133848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4420788e-aa87-409f-ba19-4c87c23c2759 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:17.143421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e0a2-de0f-481b-8201-c3c716f4cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:17.144392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e0a2-de0f-481b-8201-c3c716f4cbc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:17.144699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e0a2-de0f-481b-8201-c3c716f4cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:17.144980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c995e0a2-de0f-481b-8201-c3c716f4cbc6 admin admin] PATH_INFO: `/v3/projects/3d14816a88554872924f0545078fd6b6/users/0c5e7aa6158e42f5a41aeb8f9b36c2de/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:17.170654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995e0a2-de0f-481b-8201-c3c716f4cbc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d14816a88554872924f0545078fd6b6, user_id=0c5e7aa6158e42f5a41aeb8f9b36c2de, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:17.174328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c995e0a2-de0f-481b-8201-c3c716f4cbc6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:17.318536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 892/1805] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:17 2022] PUT /identity/v3/projects/3d14816a88554872924f0545078fd6b6/users/0c5e7aa6158e42f5a41aeb8f9b36c2de/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:17.322515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b5b7c-25d3-4ba3-8c99-eee404670a77 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:17.359801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b5b7c-25d3-4ba3-8c99-eee404670a77 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:17.440010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e0a2-de0f-481b-8201-c3c716f4cbc6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:17.442269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c995e0a2-de0f-481b-8201-c3c716f4cbc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:17.461681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5137805-74b3-4ef4-a689-2773d7c776d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:17.461681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5137805-74b3-4ef4-a689-2773d7c776d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:17.461681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5137805-74b3-4ef4-a689-2773d7c776d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:17.461681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5137805-74b3-4ef4-a689-2773d7c776d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:17.462243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5137805-74b3-4ef4-a689-2773d7c776d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:17.463812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5137805-74b3-4ef4-a689-2773d7c776d4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:17.477763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 914/1806] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:17 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:17.479144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5137805-74b3-4ef4-a689-2773d7c776d4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:17.490862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5137805-74b3-4ef4-a689-2773d7c776d4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:17.496836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c476f-b3de-483f-ba40-11fd02f08a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:17.497739 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c476f-b3de-483f-ba40-11fd02f08a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:17.498014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c476f-b3de-483f-ba40-11fd02f08a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:17.498293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c476f-b3de-483f-ba40-11fd02f08a0b admin admin] PATH_INFO: `/v3/projects/3d14816a88554872924f0545078fd6b6/users/0c5e7aa6158e42f5a41aeb8f9b36c2de/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:17.501158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c476f-b3de-483f-ba40-11fd02f08a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d14816a88554872924f0545078fd6b6, user_id=0c5e7aa6158e42f5a41aeb8f9b36c2de, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:17.503911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c476f-b3de-483f-ba40-11fd02f08a0b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:17.515565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 915/1807] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:17 2022] PUT /identity/v3/projects/3d14816a88554872924f0545078fd6b6/users/0c5e7aa6158e42f5a41aeb8f9b36c2de/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:17.524997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:17.526016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55afa4-fc45-4c2d-8214-d281d44348a3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:17.526312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55afa4-fc45-4c2d-8214-d281d44348a3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:17.526592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55afa4-fc45-4c2d-8214-d281d44348a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:17.529830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c995e0a2-de0f-481b-8201-c3c716f4cbc6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:17.552956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6b55afa4-fc45-4c2d-8214-d281d44348a3 None None] MFA Rules not processed for user `0c5e7aa6158e42f5a41aeb8f9b36c2de`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:17.554481 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6b55afa4-fc45-4c2d-8214-d281d44348a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:17.594841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:17.595756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:17.596034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:17.596312 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] PATH_INFO: `/v3/users/36b58ded0bf4408c9770a96a4a899e70` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:17.597581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=36b58ded0bf4408c9770a96a4a899e70)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:17.599536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:17.631001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 916/1808] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:17.641886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55afa4-fc45-4c2d-8214-d281d44348a3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:17.643350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6b55afa4-fc45-4c2d-8214-d281d44348a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:17.704059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55afa4-fc45-4c2d-8214-d281d44348a3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:17.705541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637ec63-f496-453a-a092-befe048fc415 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:17.706195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637ec63-f496-453a-a092-befe048fc415 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:17.706500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637ec63-f496-453a-a092-befe048fc415 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:17.706882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637ec63-f496-453a-a092-befe048fc415 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:17.734296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637ec63-f496-453a-a092-befe048fc415 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:17.735777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637ec63-f496-453a-a092-befe048fc415 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:17.751822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 917/1809] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:17.845215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:17.910124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36b58ded0bf4408c9770a96a4a899e70'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:17.927857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36b58ded0bf4408c9770a96a4a899e70'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:17.928762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36b58ded0bf4408c9770a96a4a899e70'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:17.941471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36b58ded0bf4408c9770a96a4a899e70'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:17.942158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36b58ded0bf4408c9770a96a4a899e70'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:18.000228 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637ec63-f496-453a-a092-befe048fc415 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:18.002782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5637ec63-f496-453a-a092-befe048fc415 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:18.015651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637ec63-f496-453a-a092-befe048fc415 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:18.020330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c2861-5f83-4f4c-b72f-802257d4e882 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:18.021017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2861-5f83-4f4c-b72f-802257d4e882 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:18.021304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2861-5f83-4f4c-b72f-802257d4e882 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:18.021829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c2861-5f83-4f4c-b72f-802257d4e882 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:18.023624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d64c2861-5f83-4f4c-b72f-802257d4e882 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:18.084034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c2861-5f83-4f4c-b72f-802257d4e882 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:18.085610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c2861-5f83-4f4c-b72f-802257d4e882 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:18.096251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 918/1810] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:18.102769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 893/1811] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:17 2022] DELETE /identity/v3/users/36b58ded0bf4408c9770a96a4a899e70 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:18.107741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad555e02-f8f9-42c8-b7aa-2f2d4d352ec8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:18.108105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad555e02-f8f9-42c8-b7aa-2f2d4d352ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:18.108497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad555e02-f8f9-42c8-b7aa-2f2d4d352ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:18.135166 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ad555e02-f8f9-42c8-b7aa-2f2d4d352ec8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:18.136414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ad555e02-f8f9-42c8-b7aa-2f2d4d352ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:18.198700 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 919/1812] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:18.209039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:18.210473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:18.270094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd477b-025a-4640-8aba-445055f5ff4a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:18.275360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70808b6-87c7-4b9f-89e9-de78315e7f98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:18.276042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70808b6-87c7-4b9f-89e9-de78315e7f98 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:18.276330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70808b6-87c7-4b9f-89e9-de78315e7f98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:18.276713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70808b6-87c7-4b9f-89e9-de78315e7f98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:18.288316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70808b6-87c7-4b9f-89e9-de78315e7f98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:18.290267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70808b6-87c7-4b9f-89e9-de78315e7f98 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:18.304745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 894/1813] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:18.978948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad555e02-f8f9-42c8-b7aa-2f2d4d352ec8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:18.981386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ad555e02-f8f9-42c8-b7aa-2f2d4d352ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:19.012331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad555e02-f8f9-42c8-b7aa-2f2d4d352ec8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:19.020545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:19.021780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:19.022239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:19.022668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] PATH_INFO: `/v3/projects/e060462807db4929a77dfa5236447914` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:19.033617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e060462807db4929a77dfa5236447914)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:19.035634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:19.066890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70808b6-87c7-4b9f-89e9-de78315e7f98 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:19.068646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f70808b6-87c7-4b9f-89e9-de78315e7f98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:19.083603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70808b6-87c7-4b9f-89e9-de78315e7f98 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:19.088344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:19.089328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:19.089696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:19.090018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] PATH_INFO: `/v3/users/dcba04d525f54bbc945541e846725b44` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:19.091437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcba04d525f54bbc945541e846725b44)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:19.094136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:19.351546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e060462807db4929a77dfa5236447914', 'request_id': 'req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.359578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e060462807db4929a77dfa5236447914', 'request_id': 'req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.366263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e060462807db4929a77dfa5236447914', 'request_id': 'req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.448924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] The token cache is being invalidate because project e060462807db4929a77dfa5236447914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:19.449333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.449901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcba04d525f54bbc945541e846725b44'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.450063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.452093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 920/1814] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:18 2022] DELETE /identity/v3/projects/e060462807db4929a77dfa5236447914 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:19.457110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:19.459125 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:19.460055 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcba04d525f54bbc945541e846725b44'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.460833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcba04d525f54bbc945541e846725b44'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.481710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcba04d525f54bbc945541e846725b44'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.483154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c80f9afd-2269-4237-8a21-845b4b62f0e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcba04d525f54bbc945541e846725b44'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.575724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d4999-8ea0-42d6-852c-d6f943e03b7b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:19.576049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 895/1815] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:19 2022] DELETE /identity/v3/users/dcba04d525f54bbc945541e846725b44 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:19.586553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37adcbb-9a63-4911-b53b-6a71601388f9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:19.586553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37adcbb-9a63-4911-b53b-6a71601388f9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:19.586553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37adcbb-9a63-4911-b53b-6a71601388f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:19.616226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c37adcbb-9a63-4911-b53b-6a71601388f9 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:19.617586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c37adcbb-9a63-4911-b53b-6a71601388f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:19.650319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:19.651281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:19.651561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:19.651835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] PATH_INFO: `/v3/users/760e3e14e2b845179f55e10bc331a6b6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:19.653072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=760e3e14e2b845179f55e10bc331a6b6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:19.655066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:19.691366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 896/1816] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:19.701049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37adcbb-9a63-4911-b53b-6a71601388f9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:19.702526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c37adcbb-9a63-4911-b53b-6a71601388f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:19.769108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37adcbb-9a63-4911-b53b-6a71601388f9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:19.773267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01facc-b1ff-4643-a673-d7c30b237eff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:19.773995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01facc-b1ff-4643-a673-d7c30b237eff service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:19.774344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01facc-b1ff-4643-a673-d7c30b237eff service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:19.774687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01facc-b1ff-4643-a673-d7c30b237eff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:19.803167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01facc-b1ff-4643-a673-d7c30b237eff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:19.805318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c01facc-b1ff-4643-a673-d7c30b237eff service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:19.831837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 897/1817] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:19.895873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '760e3e14e2b845179f55e10bc331a6b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:19.915551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '760e3e14e2b845179f55e10bc331a6b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:20.043785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '760e3e14e2b845179f55e10bc331a6b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:20.044798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '760e3e14e2b845179f55e10bc331a6b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:20.045566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '760e3e14e2b845179f55e10bc331a6b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:20.063581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 921/1818] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:19 2022] DELETE /identity/v3/users/760e3e14e2b845179f55e10bc331a6b6 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:20.639284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01facc-b1ff-4643-a673-d7c30b237eff service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:20.641298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4c01facc-b1ff-4643-a673-d7c30b237eff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:20.657449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01facc-b1ff-4643-a673-d7c30b237eff service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:20.709931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:20.712545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:20.732902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:20.733886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:20.734498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:20.735003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] PATH_INFO: `/v3/projects/d2486ebb1ba8473d8e554470db4df7f8` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:20.736621 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2486ebb1ba8473d8e554470db4df7f8)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:20.738692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:20.793209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad7129d-63d1-4e47-bca9-7d3ae85d5e70 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:20.798838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:20.802878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:20.802878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:20.802878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] PATH_INFO: `/v3/projects/f344adc209144055b19cd20fc11a36b8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:20.802878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=f344adc209144055b19cd20fc11a36b8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:20.803655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:20.898691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2486ebb1ba8473d8e554470db4df7f8', 'request_id': 'req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:20.906522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2486ebb1ba8473d8e554470db4df7f8', 'request_id': 'req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:20.912219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2486ebb1ba8473d8e554470db4df7f8', 'request_id': 'req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:20.931338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f344adc209144055b19cd20fc11a36b8', 'request_id': 'req-64a89f8e-c752-4812-9afd-deed618302ec'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:20.937447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f344adc209144055b19cd20fc11a36b8', 'request_id': 'req-64a89f8e-c752-4812-9afd-deed618302ec'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:20.942752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f344adc209144055b19cd20fc11a36b8', 'request_id': 'req-64a89f8e-c752-4812-9afd-deed618302ec'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.009782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] The token cache is being invalidate because project d2486ebb1ba8473d8e554470db4df7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:21.010075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.010690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.012264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 898/1819] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:20 2022] DELETE /identity/v3/projects/d2486ebb1ba8473d8e554470db4df7f8 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:21.013052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:21.014342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:21.084490 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bb09d-c00b-4f64-b2ec-f2e57afc3e32 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:21.143860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:21.144780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:21.145069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:21.145344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] PATH_INFO: `/v3/users/9496d1c3fa004f9dbd9254d82c38a74e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:21.146567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9496d1c3fa004f9dbd9254d82c38a74e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:21.148497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:21.186448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] The token cache is being invalidate because project f344adc209144055b19cd20fc11a36b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:21.187697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.188067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.190157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 922/1820] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:20 2022] DELETE /identity/v3/projects/f344adc209144055b19cd20fc11a36b8 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:21.190960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:21.192761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:21.206320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a89f8e-c752-4812-9afd-deed618302ec admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:21.211158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:21.212062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:21.212337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:21.212718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] PATH_INFO: `/v3/users/0c5e7aa6158e42f5a41aeb8f9b36c2de` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:21.213928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5e7aa6158e42f5a41aeb8f9b36c2de)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:21.220562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:21.399599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9496d1c3fa004f9dbd9254d82c38a74e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.406381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9496d1c3fa004f9dbd9254d82c38a74e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.407041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9496d1c3fa004f9dbd9254d82c38a74e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.419787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9496d1c3fa004f9dbd9254d82c38a74e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.420432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9496d1c3fa004f9dbd9254d82c38a74e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.423452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5e7aa6158e42f5a41aeb8f9b36c2de'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.434780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5e7aa6158e42f5a41aeb8f9b36c2de'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.501943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 899/1821] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:21 2022] DELETE /identity/v3/users/9496d1c3fa004f9dbd9254d82c38a74e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:21.502801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:21.504217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:21.541961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5e7aa6158e42f5a41aeb8f9b36c2de'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.543876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5e7aa6158e42f5a41aeb8f9b36c2de'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.544778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-20937b85-1d81-4176-91c6-5a76d72e5228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5e7aa6158e42f5a41aeb8f9b36c2de'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.563369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 923/1822] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:21 2022] DELETE /identity/v3/users/0c5e7aa6158e42f5a41aeb8f9b36c2de => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:21.566368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3189-f0d3-4103-a0cf-c88b942a5e1a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:21.566368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3189-f0d3-4103-a0cf-c88b942a5e1a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:21.566368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef3189-f0d3-4103-a0cf-c88b942a5e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:21.590317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410c6981-0237-4636-aa4a-e887ecf6a10c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:21.595664 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9eef3189-f0d3-4103-a0cf-c88b942a5e1a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:21.596987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9eef3189-f0d3-4103-a0cf-c88b942a5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:21.672241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:21.673898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:21.674214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:21.674479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] PATH_INFO: `/v3/users/757d34984533455ab9d859b515907123` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:21.676338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=757d34984533455ab9d859b515907123)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:21.680314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:21.689907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:21.711575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 924/1823] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:21.725504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3189-f0d3-4103-a0cf-c88b942a5e1a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:21.726949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9eef3189-f0d3-4103-a0cf-c88b942a5e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:21.794974 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef3189-f0d3-4103-a0cf-c88b942a5e1a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:21.799617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d601-5833-4d1f-bda8-94c0b892e57c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:21.800270 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d601-5833-4d1f-bda8-94c0b892e57c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:21.800593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d601-5833-4d1f-bda8-94c0b892e57c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:21.800873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd13d601-5833-4d1f-bda8-94c0b892e57c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:21.810562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13d601-5833-4d1f-bda8-94c0b892e57c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:21.812055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd13d601-5833-4d1f-bda8-94c0b892e57c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:21.821775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 925/1824] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:21.941158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '757d34984533455ab9d859b515907123'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.949639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '757d34984533455ab9d859b515907123'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.950616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '757d34984533455ab9d859b515907123'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.964575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:21.965842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '757d34984533455ab9d859b515907123'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:21.966639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-868db8b5-93d2-48a9-9e3f-4eda84538eb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '757d34984533455ab9d859b515907123'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.079149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 900/1825] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:21 2022] DELETE /identity/v3/users/757d34984533455ab9d859b515907123 => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:22.117451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d601-5833-4d1f-bda8-94c0b892e57c service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:22.119006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bd13d601-5833-4d1f-bda8-94c0b892e57c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:22.162759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd13d601-5833-4d1f-bda8-94c0b892e57c service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:22.247665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:22.250600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:22.250916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:22.251194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] PATH_INFO: `/v3/projects/3d14816a88554872924f0545078fd6b6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:22.253923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d14816a88554872924f0545078fd6b6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:22.256427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:22.390471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d14816a88554872924f0545078fd6b6', 'request_id': 'req-74fe539e-89df-470c-8feb-1f9ecb70173e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.410012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d14816a88554872924f0545078fd6b6', 'request_id': 'req-74fe539e-89df-470c-8feb-1f9ecb70173e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.432931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d14816a88554872924f0545078fd6b6', 'request_id': 'req-74fe539e-89df-470c-8feb-1f9ecb70173e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.538482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] The token cache is being invalidate because project 3d14816a88554872924f0545078fd6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:22.538839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.539782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74fe539e-89df-470c-8feb-1f9ecb70173e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.541921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 926/1826] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:22 2022] DELETE /identity/v3/projects/3d14816a88554872924f0545078fd6b6 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:22.547041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c376e6a-0993-4cd7-abeb-0b145f1ed807 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:22.547326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c376e6a-0993-4cd7-abeb-0b145f1ed807 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:22.547615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c376e6a-0993-4cd7-abeb-0b145f1ed807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:22.567141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4c376e6a-0993-4cd7-abeb-0b145f1ed807 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:22.568407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4c376e6a-0993-4cd7-abeb-0b145f1ed807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:22.630613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 901/1827] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:22.639146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def416-1140-4fb3-a190-7a57440d35f2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:22.639359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def416-1140-4fb3-a190-7a57440d35f2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:22.639618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4def416-1140-4fb3-a190-7a57440d35f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:22.650699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c376e6a-0993-4cd7-abeb-0b145f1ed807 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:22.652654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4c376e6a-0993-4cd7-abeb-0b145f1ed807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:22.664130 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e4def416-1140-4fb3-a190-7a57440d35f2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:22.665821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e4def416-1140-4fb3-a190-7a57440d35f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:22.675641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c376e6a-0993-4cd7-abeb-0b145f1ed807 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:22.683070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:22.684191 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:22.684464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:22.684742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] PATH_INFO: `/v3/projects/5a9242ea370044668df6476c0bbb5cdb` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:22.686061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9242ea370044668df6476c0bbb5cdb)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:22.690284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:22.695991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 927/1828] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:22.701464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def416-1140-4fb3-a190-7a57440d35f2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:22.712996 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4def416-1140-4fb3-a190-7a57440d35f2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:22.719118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f039f6-be47-4edf-812f-e72dff967e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:22.720186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f039f6-be47-4edf-812f-e72dff967e43 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:22.720571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f039f6-be47-4edf-812f-e72dff967e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:22.720926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f039f6-be47-4edf-812f-e72dff967e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:22.721671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f039f6-be47-4edf-812f-e72dff967e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:22.721984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f039f6-be47-4edf-812f-e72dff967e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:22.723643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f039f6-be47-4edf-812f-e72dff967e43 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:22.737975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 928/1829] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:37:22.743117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f039f6-be47-4edf-812f-e72dff967e43 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:22.758973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f039f6-be47-4edf-812f-e72dff967e43 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:22.764714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f38f1b-3c94-4b82-a329-2482b083e8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:22.766052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f38f1b-3c94-4b82-a329-2482b083e8ae admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:22.766335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f38f1b-3c94-4b82-a329-2482b083e8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:22.766613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f38f1b-3c94-4b82-a329-2482b083e8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:22.767422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f38f1b-3c94-4b82-a329-2482b083e8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:22.769782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f38f1b-3c94-4b82-a329-2482b083e8ae admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:22.807529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9242ea370044668df6476c0bbb5cdb', 'request_id': 'req-60323cb3-84ce-42ba-b155-17a6599ef1a5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.815002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9242ea370044668df6476c0bbb5cdb', 'request_id': 'req-60323cb3-84ce-42ba-b155-17a6599ef1a5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.822053 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9242ea370044668df6476c0bbb5cdb', 'request_id': 'req-60323cb3-84ce-42ba-b155-17a6599ef1a5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.922318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 929/1830] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:22 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:22.923469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f38f1b-3c94-4b82-a329-2482b083e8ae admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:22.923946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] The token cache is being invalidate because project 5a9242ea370044668df6476c0bbb5cdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:22.924331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.925173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:22.925303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-23f38f1b-3c94-4b82-a329-2482b083e8ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:22.929740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 902/1831] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:22 2022] DELETE /identity/v3/projects/5a9242ea370044668df6476c0bbb5cdb => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:22.930826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:22.932781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:23.007052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60323cb3-84ce-42ba-b155-17a6599ef1a5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.012172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1ab09-598d-4ede-8154-bb9d097cc838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:23.013067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1ab09-598d-4ede-8154-bb9d097cc838 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.013575 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1ab09-598d-4ede-8154-bb9d097cc838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.014047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b1ab09-598d-4ede-8154-bb9d097cc838 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.015434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1ab09-598d-4ede-8154-bb9d097cc838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:23.017598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b1ab09-598d-4ede-8154-bb9d097cc838 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:23.017860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f38f1b-3c94-4b82-a329-2482b083e8ae admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.023236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:23.024416 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.024416 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.024734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] PATH_INFO: `/v3/projects/23af2ee4f4de488783be99a38e051ec2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.028899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23af2ee4f4de488783be99a38e051ec2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:23.028899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:23.139121 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 903/1832] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:22 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:23.139121 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1ab09-598d-4ede-8154-bb9d097cc838 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:23.139121 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-77b1ab09-598d-4ede-8154-bb9d097cc838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:23.152357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b1ab09-598d-4ede-8154-bb9d097cc838 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.157660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:23.158536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.158813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.159114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] PATH_INFO: `/v3/users/d5245d13a47742d7abc52e8429eb1c52` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.160332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5245d13a47742d7abc52e8429eb1c52)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:23.162310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:23.195405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23af2ee4f4de488783be99a38e051ec2', 'request_id': 'req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.201864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23af2ee4f4de488783be99a38e051ec2', 'request_id': 'req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.209204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23af2ee4f4de488783be99a38e051ec2', 'request_id': 'req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.335533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] The token cache is being invalidate because project 23af2ee4f4de488783be99a38e051ec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:23.336210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.336734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.338494 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 930/1833] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:22 2022] DELETE /identity/v3/projects/23af2ee4f4de488783be99a38e051ec2 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:23.339399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:23.340740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:23.406045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4919ca-a253-4b1b-b8fa-2c903d462bf7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.410770 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b280bd-da4e-47d8-9e8d-60128c8d5b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:23.411433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b280bd-da4e-47d8-9e8d-60128c8d5b54 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.411716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b280bd-da4e-47d8-9e8d-60128c8d5b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.411995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b280bd-da4e-47d8-9e8d-60128c8d5b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.412750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b280bd-da4e-47d8-9e8d-60128c8d5b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:23.414475 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b280bd-da4e-47d8-9e8d-60128c8d5b54 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:23.425237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 931/1834] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:23.426650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed585e1-4583-453d-988b-f122df992b71 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.426944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed585e1-4583-453d-988b-f122df992b71 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.427224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed585e1-4583-453d-988b-f122df992b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.442850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5245d13a47742d7abc52e8429eb1c52'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.447408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8ed585e1-4583-453d-988b-f122df992b71 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:23.448674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8ed585e1-4583-453d-988b-f122df992b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:23.450770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5245d13a47742d7abc52e8429eb1c52'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.451837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5245d13a47742d7abc52e8429eb1c52'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.458014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 932/1835] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:23.459040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed585e1-4583-453d-988b-f122df992b71 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:23.460370 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8ed585e1-4583-453d-988b-f122df992b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:23.470280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5245d13a47742d7abc52e8429eb1c52'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.471026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5245d13a47742d7abc52e8429eb1c52'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:23.474188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed585e1-4583-453d-988b-f122df992b71 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.481036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84810c-2544-44eb-8e13-5a082963b31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:23.481711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84810c-2544-44eb-8e13-5a082963b31f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.481995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84810c-2544-44eb-8e13-5a082963b31f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.482293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84810c-2544-44eb-8e13-5a082963b31f admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.483072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84810c-2544-44eb-8e13-5a082963b31f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:23.485690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84810c-2544-44eb-8e13-5a082963b31f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:23.496571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 933/1836] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:23.499976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e536-a13a-4b0d-a15d-9a8b55c0dd88 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.499976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e536-a13a-4b0d-a15d-9a8b55c0dd88 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.499976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e536-a13a-4b0d-a15d-9a8b55c0dd88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.517596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4db7e536-a13a-4b0d-a15d-9a8b55c0dd88 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:23.518815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4db7e536-a13a-4b0d-a15d-9a8b55c0dd88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:23.527045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 934/1837] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:23.527981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7e536-a13a-4b0d-a15d-9a8b55c0dd88 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:23.537992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7e536-a13a-4b0d-a15d-9a8b55c0dd88 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.542772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c0c2-2767-4a91-8d7b-b9ce2055d7cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:23.543646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c0c2-2767-4a91-8d7b-b9ce2055d7cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.543926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c0c2-2767-4a91-8d7b-b9ce2055d7cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.544198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c0c2-2767-4a91-8d7b-b9ce2055d7cb admin admin] PATH_INFO: `/v3/projects/4325c3b646f549e0b2219a2fb9c59349/users/8d9b7a61f31245a2bf4d37b05533602b/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.559105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4c0c2-2767-4a91-8d7b-b9ce2055d7cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4325c3b646f549e0b2219a2fb9c59349, user_id=8d9b7a61f31245a2bf4d37b05533602b, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:23.561921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc4c0c2-2767-4a91-8d7b-b9ce2055d7cb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:23.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 904/1838] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:23 2022] DELETE /identity/v3/users/d5245d13a47742d7abc52e8429eb1c52 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:23.567682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:23.640686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7653ea71-ce86-45d8-9686-20af4b032672 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.649726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178a788-46f9-4fe8-a2b4-780bb1483de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:23.650421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a788-46f9-4fe8-a2b4-780bb1483de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.650706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a788-46f9-4fe8-a2b4-780bb1483de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.650985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178a788-46f9-4fe8-a2b4-780bb1483de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.651731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178a788-46f9-4fe8-a2b4-780bb1483de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:23.652048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178a788-46f9-4fe8-a2b4-780bb1483de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:23.653694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178a788-46f9-4fe8-a2b4-780bb1483de5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:23.666798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 905/1840] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:23.668367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 935/1840] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:23 2022] PUT /identity/v3/projects/4325c3b646f549e0b2219a2fb9c59349/users/8d9b7a61f31245a2bf4d37b05533602b/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:23.671004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c0c2-2767-4a91-8d7b-b9ce2055d7cb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:23.673493 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376153c-91e8-4069-8f1e-5c3da7f52a3d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.673847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376153c-91e8-4069-8f1e-5c3da7f52a3d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.674068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376153c-91e8-4069-8f1e-5c3da7f52a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.716035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a376153c-91e8-4069-8f1e-5c3da7f52a3d None None] MFA Rules not processed for user `8d9b7a61f31245a2bf4d37b05533602b`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:23.717500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a376153c-91e8-4069-8f1e-5c3da7f52a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:23.743197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c0c2-2767-4a91-8d7b-b9ce2055d7cb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.751736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b243c-8c42-4f7d-a2a2-0f36ec7a8fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:23.752490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b243c-8c42-4f7d-a2a2-0f36ec7a8fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.752784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b243c-8c42-4f7d-a2a2-0f36ec7a8fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.753055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998b243c-8c42-4f7d-a2a2-0f36ec7a8fa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.757265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b243c-8c42-4f7d-a2a2-0f36ec7a8fa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:23.757265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998b243c-8c42-4f7d-a2a2-0f36ec7a8fa5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:23.793156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 906/1841] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:23.805478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376153c-91e8-4069-8f1e-5c3da7f52a3d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:23.806954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a376153c-91e8-4069-8f1e-5c3da7f52a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:23.857446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 936/1842] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:23 2022] POST /identity/v3/projects => generated 387 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:23.861252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b243c-8c42-4f7d-a2a2-0f36ec7a8fa5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:23.914963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376153c-91e8-4069-8f1e-5c3da7f52a3d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.943873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998b243c-8c42-4f7d-a2a2-0f36ec7a8fa5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:23.950083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29d66-cb24-4797-a4bc-4a5ad34cf2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:23.950949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29d66-cb24-4797-a4bc-4a5ad34cf2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:23.951285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29d66-cb24-4797-a4bc-4a5ad34cf2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:23.951552 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d29d66-cb24-4797-a4bc-4a5ad34cf2f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:23.952264 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29d66-cb24-4797-a4bc-4a5ad34cf2f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:23.955311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d29d66-cb24-4797-a4bc-4a5ad34cf2f3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.001094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43152231-9b52-4836-aef7-7bd98180141e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:24.001769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152231-9b52-4836-aef7-7bd98180141e service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.002060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152231-9b52-4836-aef7-7bd98180141e service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.002346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43152231-9b52-4836-aef7-7bd98180141e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.069432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43152231-9b52-4836-aef7-7bd98180141e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:24.070894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43152231-9b52-4836-aef7-7bd98180141e service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.088087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 907/1843] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:24.114367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43152231-9b52-4836-aef7-7bd98180141e service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:24.135387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 937/1844] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:23 2022] POST /identity/v3/users => generated 294 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:24.136457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29d66-cb24-4797-a4bc-4a5ad34cf2f3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:24.137695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43152231-9b52-4836-aef7-7bd98180141e service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:24.138341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-95d29d66-cb24-4797-a4bc-4a5ad34cf2f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:24.143775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:24.145697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.145999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.148737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] PATH_INFO: `/v3/users/8d9b7a61f31245a2bf4d37b05533602b` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.160269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d29d66-cb24-4797-a4bc-4a5ad34cf2f3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:24.162370 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9b7a61f31245a2bf4d37b05533602b)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:24.164519 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.176386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:24.177305 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.177690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.178042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] PATH_INFO: `/v3/projects/363056372dc24ec4bffccf02e52a21c0` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.179674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=363056372dc24ec4bffccf02e52a21c0)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:24.181672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.434257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9b7a61f31245a2bf4d37b05533602b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.443132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363056372dc24ec4bffccf02e52a21c0', 'request_id': 'req-8467cd2c-ff0a-4fba-9813-9b0d987948e3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.445094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9b7a61f31245a2bf4d37b05533602b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.446115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9b7a61f31245a2bf4d37b05533602b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.456034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363056372dc24ec4bffccf02e52a21c0', 'request_id': 'req-8467cd2c-ff0a-4fba-9813-9b0d987948e3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.461926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9b7a61f31245a2bf4d37b05533602b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.462766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9b7a61f31245a2bf4d37b05533602b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.463648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363056372dc24ec4bffccf02e52a21c0', 'request_id': 'req-8467cd2c-ff0a-4fba-9813-9b0d987948e3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.548546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 908/1845] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:24 2022] DELETE /identity/v3/users/8d9b7a61f31245a2bf4d37b05533602b => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:24.552465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:24.554065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:24.612929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] The token cache is being invalidate because project 363056372dc24ec4bffccf02e52a21c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:24.613529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.614577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8467cd2c-ff0a-4fba-9813-9b0d987948e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:24.618029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 938/1846] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:24 2022] DELETE /identity/v3/projects/363056372dc24ec4bffccf02e52a21c0 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:24.635273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f37-5562-4771-adcd-d15ed672583c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.635901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f37-5562-4771-adcd-d15ed672583c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.637943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15e0f37-5562-4771-adcd-d15ed672583c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.639124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7aa30-45b8-4266-9159-353d506b2186 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:24.647204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601ee23-b44b-40fa-b65a-ae1d7bd4bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:24.647204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601ee23-b44b-40fa-b65a-ae1d7bd4bd32 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.647475 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601ee23-b44b-40fa-b65a-ae1d7bd4bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.647822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601ee23-b44b-40fa-b65a-ae1d7bd4bd32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.648641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601ee23-b44b-40fa-b65a-ae1d7bd4bd32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:24.650316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601ee23-b44b-40fa-b65a-ae1d7bd4bd32 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.666183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 909/1847] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:24.667655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a0d4d-58b9-474b-b682-f26d4dbde223 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.668122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a0d4d-58b9-474b-b682-f26d4dbde223 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.668967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a0d4d-58b9-474b-b682-f26d4dbde223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.677872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b15e0f37-5562-4771-adcd-d15ed672583c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:24.679720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b15e0f37-5562-4771-adcd-d15ed672583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:24.690643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 939/1848] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:24.691608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0f37-5562-4771-adcd-d15ed672583c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:24.696505 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b15e0f37-5562-4771-adcd-d15ed672583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:24.697933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fa6a0d4d-58b9-474b-b682-f26d4dbde223 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:24.699261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fa6a0d4d-58b9-474b-b682-f26d4dbde223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:24.710037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 910/1849] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:24.719178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a0d4d-58b9-474b-b682-f26d4dbde223 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:24.720769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fa6a0d4d-58b9-474b-b682-f26d4dbde223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:24.739808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15e0f37-5562-4771-adcd-d15ed672583c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:24.751857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2ac8d-912d-485d-a23a-ee3b67e226b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:24.752852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2ac8d-912d-485d-a23a-ee3b67e226b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.753246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2ac8d-912d-485d-a23a-ee3b67e226b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.776787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2ac8d-912d-485d-a23a-ee3b67e226b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.792254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2ac8d-912d-485d-a23a-ee3b67e226b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:24.793154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a0d4d-58b9-474b-b682-f26d4dbde223 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:24.795694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e2ac8d-912d-485d-a23a-ee3b67e226b0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.799874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238b3a9-e448-4bdc-abf4-34ffa6e6fbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:24.799874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b3a9-e448-4bdc-abf4-34ffa6e6fbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.799874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b3a9-e448-4bdc-abf4-34ffa6e6fbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.799874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238b3a9-e448-4bdc-abf4-34ffa6e6fbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.813079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238b3a9-e448-4bdc-abf4-34ffa6e6fbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:24.819059 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238b3a9-e448-4bdc-abf4-34ffa6e6fbc0 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.822240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 940/1850] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:24.823703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef4863-da2c-4227-81de-29023b0b6126 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.823999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef4863-da2c-4227-81de-29023b0b6126 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.824285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef4863-da2c-4227-81de-29023b0b6126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.833348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 911/1851] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:24.834557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238b3a9-e448-4bdc-abf4-34ffa6e6fbc0 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:24.846282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238b3a9-e448-4bdc-abf4-34ffa6e6fbc0 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:24.850857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-23ef4863-da2c-4227-81de-29023b0b6126 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:24.852419 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f65e041-44f0-4b11-97e2-c1db0db4a311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:24.852673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-23ef4863-da2c-4227-81de-29023b0b6126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:24.854175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65e041-44f0-4b11-97e2-c1db0db4a311 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.854651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65e041-44f0-4b11-97e2-c1db0db4a311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.858146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f65e041-44f0-4b11-97e2-c1db0db4a311 admin admin] PATH_INFO: `/v3/projects/bf4379509de14d9094d25fa0846cfa5e/users/a620f5087c1343b79d7b10b1505f5143/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.864188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 941/1852] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:24.869188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef4863-da2c-4227-81de-29023b0b6126 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:24.876890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65e041-44f0-4b11-97e2-c1db0db4a311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf4379509de14d9094d25fa0846cfa5e, user_id=a620f5087c1343b79d7b10b1505f5143, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:24.881849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f65e041-44f0-4b11-97e2-c1db0db4a311 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.886954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef4863-da2c-4227-81de-29023b0b6126 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:24.894588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd6fe-5d36-4f58-8ce7-68bc03cb98c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:24.896892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd6fe-5d36-4f58-8ce7-68bc03cb98c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.897381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd6fe-5d36-4f58-8ce7-68bc03cb98c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.897838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd6fe-5d36-4f58-8ce7-68bc03cb98c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.898750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd6fe-5d36-4f58-8ce7-68bc03cb98c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:24.899150 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd6fe-5d36-4f58-8ce7-68bc03cb98c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:24.901095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd6fe-5d36-4f58-8ce7-68bc03cb98c7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.915518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 942/1853] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:37:24.921055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd6fe-5d36-4f58-8ce7-68bc03cb98c7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:24.934812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd6fe-5d36-4f58-8ce7-68bc03cb98c7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:24.942188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a70fd-ab7e-4077-b9ea-4b8eea1fbd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:24.943291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a70fd-ab7e-4077-b9ea-4b8eea1fbd70 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:24.943572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a70fd-ab7e-4077-b9ea-4b8eea1fbd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:24.943846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a70fd-ab7e-4077-b9ea-4b8eea1fbd70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:24.944570 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a70fd-ab7e-4077-b9ea-4b8eea1fbd70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:24.947376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a70fd-ab7e-4077-b9ea-4b8eea1fbd70 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:24.948348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:25.017170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 912/1854] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:24 2022] PUT /identity/v3/projects/bf4379509de14d9094d25fa0846cfa5e/users/a620f5087c1343b79d7b10b1505f5143/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:25.028690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3c09d-be39-4e7e-a213-f2ac4f8a165f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.029113 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3c09d-be39-4e7e-a213-f2ac4f8a165f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.029464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3c09d-be39-4e7e-a213-f2ac4f8a165f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.064612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-09a3c09d-be39-4e7e-a213-f2ac4f8a165f None None] MFA Rules not processed for user `a620f5087c1343b79d7b10b1505f5143`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:25.066551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-09a3c09d-be39-4e7e-a213-f2ac4f8a165f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:25.090251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 943/1855] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:24 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:25.094587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a70fd-ab7e-4077-b9ea-4b8eea1fbd70 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:25.180559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:25.218683 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 913/1856] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:25.221934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3c09d-be39-4e7e-a213-f2ac4f8a165f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:25.244128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a70fd-ab7e-4077-b9ea-4b8eea1fbd70 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:25.264062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d05f3-eae9-4c9c-a572-48b4f0e0e174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:25.266137 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d05f3-eae9-4c9c-a572-48b4f0e0e174 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.266427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d05f3-eae9-4c9c-a572-48b4f0e0e174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.273089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d05f3-eae9-4c9c-a572-48b4f0e0e174 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.273849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d05f3-eae9-4c9c-a572-48b4f0e0e174 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:25.276901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d05f3-eae9-4c9c-a572-48b4f0e0e174 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:25.346250 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3c09d-be39-4e7e-a213-f2ac4f8a165f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:25.358388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8272a6c-8315-4854-85b1-02917acf2ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:25.360057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8272a6c-8315-4854-85b1-02917acf2ed0 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.363165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8272a6c-8315-4854-85b1-02917acf2ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.363165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8272a6c-8315-4854-85b1-02917acf2ed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.363165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8272a6c-8315-4854-85b1-02917acf2ed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:25.363629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8272a6c-8315-4854-85b1-02917acf2ed0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:25.396331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 944/1857] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:25 2022] POST /identity/v3/users => generated 294 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:25.400711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d05f3-eae9-4c9c-a572-48b4f0e0e174 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:25.415504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d05f3-eae9-4c9c-a572-48b4f0e0e174 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:25.421916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f179471-8ed4-499a-82fd-218ce5ca8c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:25.422604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f179471-8ed4-499a-82fd-218ce5ca8c25 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.422883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f179471-8ed4-499a-82fd-218ce5ca8c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.423155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f179471-8ed4-499a-82fd-218ce5ca8c25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.423916 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f179471-8ed4-499a-82fd-218ce5ca8c25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:25.425930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f179471-8ed4-499a-82fd-218ce5ca8c25 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:25.451954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 945/1858] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:25.451954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f179471-8ed4-499a-82fd-218ce5ca8c25 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:25.464152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f179471-8ed4-499a-82fd-218ce5ca8c25 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:25.476162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2706-cb18-47da-8bd3-176de82f457d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:25.476991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2706-cb18-47da-8bd3-176de82f457d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.477625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2706-cb18-47da-8bd3-176de82f457d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.477625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2706-cb18-47da-8bd3-176de82f457d admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.478252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2706-cb18-47da-8bd3-176de82f457d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:25.480222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2706-cb18-47da-8bd3-176de82f457d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:25.492229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 946/1859] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:25.497600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2706-cb18-47da-8bd3-176de82f457d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:25.503585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 914/1860] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:25 2022] POST /identity/v3/projects => generated 387 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:25.504637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8272a6c-8315-4854-85b1-02917acf2ed0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:25.509354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2706-cb18-47da-8bd3-176de82f457d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:25.602850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b35db1-b070-48dc-acb2-1b0e00097937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:25.603819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b35db1-b070-48dc-acb2-1b0e00097937 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.604266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b35db1-b070-48dc-acb2-1b0e00097937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.604716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b35db1-b070-48dc-acb2-1b0e00097937 admin admin] PATH_INFO: `/v3/projects/9d1aa9b724694894897904866197a79c/users/7572784b4a7640b0a4a6ede16d955e4e/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.609851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8272a6c-8315-4854-85b1-02917acf2ed0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:25.620027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7005465c-bede-44e9-a60e-d3fd37abf778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:25.620962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005465c-bede-44e9-a60e-d3fd37abf778 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.621320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005465c-bede-44e9-a60e-d3fd37abf778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.621601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005465c-bede-44e9-a60e-d3fd37abf778 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.622341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005465c-bede-44e9-a60e-d3fd37abf778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:25.625629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7005465c-bede-44e9-a60e-d3fd37abf778 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:25.626340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b35db1-b070-48dc-acb2-1b0e00097937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d1aa9b724694894897904866197a79c, user_id=7572784b4a7640b0a4a6ede16d955e4e, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:25.629174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b35db1-b070-48dc-acb2-1b0e00097937 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:25.721483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 947/1861] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:25 2022] PUT /identity/v3/projects/9d1aa9b724694894897904866197a79c/users/7572784b4a7640b0a4a6ede16d955e4e/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:25.723038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b35db1-b070-48dc-acb2-1b0e00097937 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:25.725037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-85b35db1-b070-48dc-acb2-1b0e00097937 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:25.773503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 915/1862] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:25 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:25.774712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b307-38f6-4f9b-bf33-d3d9970bfb74 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.775003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b307-38f6-4f9b-bf33-d3d9970bfb74 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.775281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217b307-38f6-4f9b-bf33-d3d9970bfb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.820038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b35db1-b070-48dc-acb2-1b0e00097937 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:25.824152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9217b307-38f6-4f9b-bf33-d3d9970bfb74 None None] MFA Rules not processed for user `7572784b4a7640b0a4a6ede16d955e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:25.825561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9217b307-38f6-4f9b-bf33-d3d9970bfb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:25.829222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:25.831116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.832295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.832869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] PATH_INFO: `/v3/projects/4325c3b646f549e0b2219a2fb9c59349` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.834657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4325c3b646f549e0b2219a2fb9c59349)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:25.837035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:25.901794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 916/1863] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:25.905301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217b307-38f6-4f9b-bf33-d3d9970bfb74 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:25.914941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217b307-38f6-4f9b-bf33-d3d9970bfb74 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:25.919873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1f889-3821-4f81-8c40-20f99fab9014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:25.920753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1f889-3821-4f81-8c40-20f99fab9014 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.921233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1f889-3821-4f81-8c40-20f99fab9014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.921702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e1f889-3821-4f81-8c40-20f99fab9014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.922691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1f889-3821-4f81-8c40-20f99fab9014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:25.924369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e1f889-3821-4f81-8c40-20f99fab9014 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:25.939095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 917/1864] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:25.940026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1f889-3821-4f81-8c40-20f99fab9014 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:25.953439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e1f889-3821-4f81-8c40-20f99fab9014 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:25.959750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd448137-96a3-424c-9ecd-687a48325888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:25.960654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd448137-96a3-424c-9ecd-687a48325888 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:25.961012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd448137-96a3-424c-9ecd-687a48325888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:25.961376 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd448137-96a3-424c-9ecd-687a48325888 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:25.962276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd448137-96a3-424c-9ecd-687a48325888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:25.965049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd448137-96a3-424c-9ecd-687a48325888 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:25.998414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4325c3b646f549e0b2219a2fb9c59349', 'request_id': 'req-16a6b040-e005-4e3c-9ade-1f455eb51510'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:26.005825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4325c3b646f549e0b2219a2fb9c59349', 'request_id': 'req-16a6b040-e005-4e3c-9ade-1f455eb51510'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:26.012304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4325c3b646f549e0b2219a2fb9c59349', 'request_id': 'req-16a6b040-e005-4e3c-9ade-1f455eb51510'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:26.053227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 918/1865] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:25 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:26.054483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd448137-96a3-424c-9ecd-687a48325888 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.085649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] The token cache is being invalidate because project 4325c3b646f549e0b2219a2fb9c59349 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:26.086022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:26.086746 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:26.088436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 948/1866] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:25 2022] DELETE /identity/v3/projects/4325c3b646f549e0b2219a2fb9c59349 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:26.089250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.090834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:26.135476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd448137-96a3-424c-9ecd-687a48325888 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.140727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22788f8-6bb5-4f83-a6f8-0e2c653acde0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.141831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22788f8-6bb5-4f83-a6f8-0e2c653acde0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.142112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22788f8-6bb5-4f83-a6f8-0e2c653acde0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.142390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22788f8-6bb5-4f83-a6f8-0e2c653acde0 admin admin] PATH_INFO: `/v3/projects/fa133ffcf65a494d8f8c37d17a700a64/users/e216a674bfde4dacbddc020a0dc68664/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.158122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22788f8-6bb5-4f83-a6f8-0e2c653acde0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa133ffcf65a494d8f8c37d17a700a64, user_id=e216a674bfde4dacbddc020a0dc68664, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.160868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22788f8-6bb5-4f83-a6f8-0e2c653acde0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.161192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6b040-e005-4e3c-9ade-1f455eb51510 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.165960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54438c-6a3b-49b6-88bb-b308392e1d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.166623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54438c-6a3b-49b6-88bb-b308392e1d0f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.166908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54438c-6a3b-49b6-88bb-b308392e1d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.167201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d54438c-6a3b-49b6-88bb-b308392e1d0f admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.167911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54438c-6a3b-49b6-88bb-b308392e1d0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.169866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d54438c-6a3b-49b6-88bb-b308392e1d0f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.284790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 919/1867] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:26 2022] PUT /identity/v3/projects/fa133ffcf65a494d8f8c37d17a700a64/users/e216a674bfde4dacbddc020a0dc68664/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:26.287833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56402d29-93c9-4596-aa40-3313c6283a31 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.287833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56402d29-93c9-4596-aa40-3313c6283a31 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.287833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56402d29-93c9-4596-aa40-3313c6283a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.305503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 949/1868] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:26 2022] POST /identity/v3/users => generated 300 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:26.306137 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54438c-6a3b-49b6-88bb-b308392e1d0f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.308861 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8d54438c-6a3b-49b6-88bb-b308392e1d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:26.314094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-56402d29-93c9-4596-aa40-3313c6283a31 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:26.315286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-56402d29-93c9-4596-aa40-3313c6283a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:26.325372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d54438c-6a3b-49b6-88bb-b308392e1d0f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.391408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 920/1869] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:26.391408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56402d29-93c9-4596-aa40-3313c6283a31 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.398215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56402d29-93c9-4596-aa40-3313c6283a31 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.403337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7028c0d-13c0-4108-b72a-2e4dae05b003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.404193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028c0d-13c0-4108-b72a-2e4dae05b003 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.404577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028c0d-13c0-4108-b72a-2e4dae05b003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.404915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7028c0d-13c0-4108-b72a-2e4dae05b003 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.405426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81ad60-d78e-4583-9a4a-a32f47ccad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.406697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81ad60-d78e-4583-9a4a-a32f47ccad15 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.406803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7028c0d-13c0-4108-b72a-2e4dae05b003 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.407015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81ad60-d78e-4583-9a4a-a32f47ccad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.407293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff81ad60-d78e-4583-9a4a-a32f47ccad15 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.408149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81ad60-d78e-4583-9a4a-a32f47ccad15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.408710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7028c0d-13c0-4108-b72a-2e4dae05b003 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.409824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff81ad60-d78e-4583-9a4a-a32f47ccad15 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.419504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 921/1870] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:26.420861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375d0d-6c9a-407e-b3c5-698c4de5302d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.421439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375d0d-6c9a-407e-b3c5-698c4de5302d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.421877 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0375d0d-6c9a-407e-b3c5-698c4de5302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.424367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 950/1871] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:26.425263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81ad60-d78e-4583-9a4a-a32f47ccad15 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.436244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff81ad60-d78e-4583-9a4a-a32f47ccad15 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.442841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8502026c-e11f-4905-9ec1-786f7533ccff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.443450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f0375d0d-6c9a-407e-b3c5-698c4de5302d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:26.444920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f0375d0d-6c9a-407e-b3c5-698c4de5302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:26.445299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502026c-e11f-4905-9ec1-786f7533ccff admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.445606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502026c-e11f-4905-9ec1-786f7533ccff admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.445945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8502026c-e11f-4905-9ec1-786f7533ccff admin admin] PATH_INFO: `/v3/projects/d1415e820fa24074ad543b8f0cc33f9f/users/ab85d13764bf4fa3b1d50d2db5b17032/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.454577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 922/1872] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:26.455516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375d0d-6c9a-407e-b3c5-698c4de5302d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.466988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0375d0d-6c9a-407e-b3c5-698c4de5302d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.467192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502026c-e11f-4905-9ec1-786f7533ccff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1415e820fa24074ad543b8f0cc33f9f, user_id=ab85d13764bf4fa3b1d50d2db5b17032, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.472917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8502026c-e11f-4905-9ec1-786f7533ccff admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.473944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261f420-7f31-4e2f-87ce-cff5981cfbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.475237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261f420-7f31-4e2f-87ce-cff5981cfbd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.475506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261f420-7f31-4e2f-87ce-cff5981cfbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.475692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261f420-7f31-4e2f-87ce-cff5981cfbd9 admin admin] PATH_INFO: `/v3/projects/fa133ffcf65a494d8f8c37d17a700a64/users/e216a674bfde4dacbddc020a0dc68664/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.478283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261f420-7f31-4e2f-87ce-cff5981cfbd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa133ffcf65a494d8f8c37d17a700a64, user_id=e216a674bfde4dacbddc020a0dc68664, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.481367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a261f420-7f31-4e2f-87ce-cff5981cfbd9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.493667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 923/1873] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:26 2022] PUT /identity/v3/projects/fa133ffcf65a494d8f8c37d17a700a64/users/e216a674bfde4dacbddc020a0dc68664/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:26.494220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261f420-7f31-4e2f-87ce-cff5981cfbd9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.563858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 951/1874] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:26 2022] PUT /identity/v3/projects/d1415e820fa24074ad543b8f0cc33f9f/users/ab85d13764bf4fa3b1d50d2db5b17032/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:26.569525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8a52-39cf-4103-a4e8-8deb7b81a6d5 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.570152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8a52-39cf-4103-a4e8-8deb7b81a6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.570742 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8a52-39cf-4103-a4e8-8deb7b81a6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.574001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:26.590965 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261f420-7f31-4e2f-87ce-cff5981cfbd9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.622951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7b3d8a52-39cf-4103-a4e8-8deb7b81a6d5 None None] MFA Rules not processed for user `e216a674bfde4dacbddc020a0dc68664`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:26.624438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7b3d8a52-39cf-4103-a4e8-8deb7b81a6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:26.701807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.704275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.704774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.705063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.706072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:26.706445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.729275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.730741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 952/1875] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:26.738300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8a52-39cf-4103-a4e8-8deb7b81a6d5 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.749924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8a52-39cf-4103-a4e8-8deb7b81a6d5 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.755745 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eb3a1-e9ef-427f-bc0b-0b4a56e35ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.756426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eb3a1-e9ef-427f-bc0b-0b4a56e35ed3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.756881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eb3a1-e9ef-427f-bc0b-0b4a56e35ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.757171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382eb3a1-e9ef-427f-bc0b-0b4a56e35ed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.758131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eb3a1-e9ef-427f-bc0b-0b4a56e35ed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.759776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382eb3a1-e9ef-427f-bc0b-0b4a56e35ed3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.760223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 924/1876] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:26.761146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.763708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:26.772104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 953/1877] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:26.773091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eb3a1-e9ef-427f-bc0b-0b4a56e35ed3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.785777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382eb3a1-e9ef-427f-bc0b-0b4a56e35ed3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.791261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810d8e5-a690-4c94-aaba-7861fd0ed6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.793730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d8e5-a690-4c94-aaba-7861fd0ed6da admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.793730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d8e5-a690-4c94-aaba-7861fd0ed6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.793730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810d8e5-a690-4c94-aaba-7861fd0ed6da admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.793730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810d8e5-a690-4c94-aaba-7861fd0ed6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.795586 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810d8e5-a690-4c94-aaba-7861fd0ed6da admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.849169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ddde9-f367-47d3-987d-fdd9b7f17c93 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.853063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a41b7f-1574-4282-be3c-01a54c29ae88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.853738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a41b7f-1574-4282-be3c-01a54c29ae88 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.854286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a41b7f-1574-4282-be3c-01a54c29ae88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.854894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a41b7f-1574-4282-be3c-01a54c29ae88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.856906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:26.871038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a41b7f-1574-4282-be3c-01a54c29ae88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.872817 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a41b7f-1574-4282-be3c-01a54c29ae88 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.884046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 925/1878] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:26 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:26.885360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a41b7f-1574-4282-be3c-01a54c29ae88 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.898432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a41b7f-1574-4282-be3c-01a54c29ae88 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:26.912155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486abde7-fec4-41bf-80c0-366c2b7f8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:26.913939 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486abde7-fec4-41bf-80c0-366c2b7f8ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.914228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486abde7-fec4-41bf-80c0-366c2b7f8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.914513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486abde7-fec4-41bf-80c0-366c2b7f8ded admin admin] PATH_INFO: `/v3/projects/d1415e820fa24074ad543b8f0cc33f9f/users/ab85d13764bf4fa3b1d50d2db5b17032/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:26.917698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486abde7-fec4-41bf-80c0-366c2b7f8ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1415e820fa24074ad543b8f0cc33f9f, user_id=ab85d13764bf4fa3b1d50d2db5b17032, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:26.925421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486abde7-fec4-41bf-80c0-366c2b7f8ded admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:26.942466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 926/1879] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:26 2022] PUT /identity/v3/projects/d1415e820fa24074ad543b8f0cc33f9f/users/ab85d13764bf4fa3b1d50d2db5b17032/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:26.946954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 954/1880] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:26 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:26.948721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486abde7-fec4-41bf-80c0-366c2b7f8ded admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:26.954726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085170a2-19e4-4824-8c68-5bd4a6a83ff3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:26.955422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085170a2-19e4-4824-8c68-5bd4a6a83ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:26.969541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085170a2-19e4-4824-8c68-5bd4a6a83ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:27.023653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-085170a2-19e4-4824-8c68-5bd4a6a83ff3 None None] MFA Rules not processed for user `ab85d13764bf4fa3b1d50d2db5b17032`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:27.025594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-085170a2-19e4-4824-8c68-5bd4a6a83ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:27.056570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486abde7-fec4-41bf-80c0-366c2b7f8ded admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:27.166124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 955/1881] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:26 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:27.167657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085170a2-19e4-4824-8c68-5bd4a6a83ff3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:27.175546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f82a5-0aa2-486c-9500-006cd47e39bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:27.176352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f82a5-0aa2-486c-9500-006cd47e39bc admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:27.176760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f82a5-0aa2-486c-9500-006cd47e39bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:27.178847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f82a5-0aa2-486c-9500-006cd47e39bc admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:27.179680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f82a5-0aa2-486c-9500-006cd47e39bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:27.183253 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f82a5-0aa2-486c-9500-006cd47e39bc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:27.191994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085170a2-19e4-4824-8c68-5bd4a6a83ff3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:27.205463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:27.207114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:27.207593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:27.208028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] PATH_INFO: `/v3/users/a620f5087c1343b79d7b10b1505f5143` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:27.209930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a620f5087c1343b79d7b10b1505f5143)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:27.212706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:27.413946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 927/1882] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:26 2022] POST /identity/v3/users => generated 289 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:27.413946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f82a5-0aa2-486c-9500-006cd47e39bc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:27.473444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a620f5087c1343b79d7b10b1505f5143'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:27.489010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f82a5-0aa2-486c-9500-006cd47e39bc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:27.492193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a620f5087c1343b79d7b10b1505f5143'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:27.495875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2440a7-d391-459b-b11f-08fe42db08f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:27.496667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2440a7-d391-459b-b11f-08fe42db08f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:27.500235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2440a7-d391-459b-b11f-08fe42db08f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:27.500235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2440a7-d391-459b-b11f-08fe42db08f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:27.510262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2440a7-d391-459b-b11f-08fe42db08f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:27.511647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2440a7-d391-459b-b11f-08fe42db08f1 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:27.523117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 928/1883] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:27 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:27.524006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2440a7-d391-459b-b11f-08fe42db08f1 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:27.535757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2440a7-d391-459b-b11f-08fe42db08f1 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:27.542842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99657a3a-4e11-4ba0-8035-550cc20ce8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:27.543956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99657a3a-4e11-4ba0-8035-550cc20ce8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:27.543956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99657a3a-4e11-4ba0-8035-550cc20ce8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:27.544406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99657a3a-4e11-4ba0-8035-550cc20ce8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:27.545285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99657a3a-4e11-4ba0-8035-550cc20ce8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:27.547612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99657a3a-4e11-4ba0-8035-550cc20ce8a9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:27.563399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 929/1884] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:27.567739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99657a3a-4e11-4ba0-8035-550cc20ce8a9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:27.587394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a620f5087c1343b79d7b10b1505f5143'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:27.588134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a620f5087c1343b79d7b10b1505f5143'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:27.588792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-28725d58-1320-4a4b-bf45-86289c26911a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a620f5087c1343b79d7b10b1505f5143'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:27.607761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99657a3a-4e11-4ba0-8035-550cc20ce8a9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:27.615644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eaa81-20a3-4f30-ac12-05cb3626cda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:27.616641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eaa81-20a3-4f30-ac12-05cb3626cda2 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:27.620635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eaa81-20a3-4f30-ac12-05cb3626cda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:27.620635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370eaa81-20a3-4f30-ac12-05cb3626cda2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:27.620635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370eaa81-20a3-4f30-ac12-05cb3626cda2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:27.621489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 956/1885] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:27 2022] DELETE /identity/v3/users/a620f5087c1343b79d7b10b1505f5143 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:27.623687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f2aea-c9e2-4726-8a53-33962399ef66 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:27.624195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f2aea-c9e2-4726-8a53-33962399ef66 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:27.625285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038f2aea-c9e2-4726-8a53-33962399ef66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:27.643591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370eaa81-20a3-4f30-ac12-05cb3626cda2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:27.652377 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-038f2aea-c9e2-4726-8a53-33962399ef66 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:27.660443 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-038f2aea-c9e2-4726-8a53-33962399ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:27.663098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 930/1886] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:27 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:27.664762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eaa81-20a3-4f30-ac12-05cb3626cda2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:27.668166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-370eaa81-20a3-4f30-ac12-05cb3626cda2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:27.685956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370eaa81-20a3-4f30-ac12-05cb3626cda2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:27.716352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:27.742380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 957/1887] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:27.746944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f2aea-c9e2-4726-8a53-33962399ef66 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:27.748701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-038f2aea-c9e2-4726-8a53-33962399ef66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:27.764588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038f2aea-c9e2-4726-8a53-33962399ef66 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:27.770627 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009f15a-3dbb-4991-b79e-4f0dcdd3ef28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:27.771784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f15a-3dbb-4991-b79e-4f0dcdd3ef28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:27.772693 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:27.772884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f15a-3dbb-4991-b79e-4f0dcdd3ef28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:27.773320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009f15a-3dbb-4991-b79e-4f0dcdd3ef28 admin admin] PATH_INFO: `/v3/projects/3b53c767a60047fca5fee1466c88ddad/users/87839dbb01b84734b7e44e4e619cc123/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:27.774143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:27.774571 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:27.774984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] PATH_INFO: `/v3/users/7572784b4a7640b0a4a6ede16d955e4e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:27.776837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7572784b4a7640b0a4a6ede16d955e4e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:27.779743 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:27.794618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009f15a-3dbb-4991-b79e-4f0dcdd3ef28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b53c767a60047fca5fee1466c88ddad, user_id=87839dbb01b84734b7e44e4e619cc123, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:27.798535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009f15a-3dbb-4991-b79e-4f0dcdd3ef28 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:27.896157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 958/1888] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:27 2022] PUT /identity/v3/projects/3b53c767a60047fca5fee1466c88ddad/users/87839dbb01b84734b7e44e4e619cc123/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:27.897029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009f15a-3dbb-4991-b79e-4f0dcdd3ef28 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:27.898643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3009f15a-3dbb-4991-b79e-4f0dcdd3ef28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:27.973927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009f15a-3dbb-4991-b79e-4f0dcdd3ef28 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:27.978127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b282778-128d-4c52-bcd6-e9ad1f8b4cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:27.978991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b282778-128d-4c52-bcd6-e9ad1f8b4cee service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:27.979548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b282778-128d-4c52-bcd6-e9ad1f8b4cee service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:27.979825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b282778-128d-4c52-bcd6-e9ad1f8b4cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:28.054964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7572784b4a7640b0a4a6ede16d955e4e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:28.057449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b282778-128d-4c52-bcd6-e9ad1f8b4cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:28.059393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b282778-128d-4c52-bcd6-e9ad1f8b4cee service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:28.063951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7572784b4a7640b0a4a6ede16d955e4e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:28.064925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7572784b4a7640b0a4a6ede16d955e4e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:28.072515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 959/1889] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:28.081513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaf374-a593-413b-8e95-0fff9280b07c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:28.081806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaf374-a593-413b-8e95-0fff9280b07c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:28.082087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcaf374-a593-413b-8e95-0fff9280b07c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:28.084221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7572784b4a7640b0a4a6ede16d955e4e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:28.086176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dc95a41c-ea96-4019-9bfc-a50c28e56fd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7572784b4a7640b0a4a6ede16d955e4e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:28.116089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8fcaf374-a593-413b-8e95-0fff9280b07c None None] MFA Rules not processed for user `87839dbb01b84734b7e44e4e619cc123`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:28.117393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8fcaf374-a593-413b-8e95-0fff9280b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:28.210759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 931/1890] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:27 2022] DELETE /identity/v3/users/7572784b4a7640b0a4a6ede16d955e4e => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:28.215297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80448a-6c5f-4541-89ff-b561bcf86939 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:28.215581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80448a-6c5f-4541-89ff-b561bcf86939 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:28.215853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80448a-6c5f-4541-89ff-b561bcf86939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:28.222336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 960/1891] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:28.235040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaf374-a593-413b-8e95-0fff9280b07c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:28.237009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8fcaf374-a593-413b-8e95-0fff9280b07c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:28.237135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5b80448a-6c5f-4541-89ff-b561bcf86939 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:28.239590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:28.240442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5b80448a-6c5f-4541-89ff-b561bcf86939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:28.329418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcaf374-a593-413b-8e95-0fff9280b07c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:28.350481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 932/1892] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:28.373882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80448a-6c5f-4541-89ff-b561bcf86939 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:28.375853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5b80448a-6c5f-4541-89ff-b561bcf86939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:28.430548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cad49c-361c-4f4d-836f-b26d736ae3ec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451754f5553e4b9783b4e75f6d408ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:28.431341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cad49c-361c-4f4d-836f-b26d736ae3ec service glance] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:28.431618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cad49c-361c-4f4d-836f-b26d736ae3ec service glance] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:28.431893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cad49c-361c-4f4d-836f-b26d736ae3ec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:28.501989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80448a-6c5f-4541-89ff-b561bcf86939 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:28.509340 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ebb5-52c0-41ee-af24-c755aabdef2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:28.510410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ebb5-52c0-41ee-af24-c755aabdef2d service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:28.510924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ebb5-52c0-41ee-af24-c755aabdef2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:28.511403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e82ebb5-52c0-41ee-af24-c755aabdef2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:28.526334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82ebb5-52c0-41ee-af24-c755aabdef2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:28.530088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e82ebb5-52c0-41ee-af24-c755aabdef2d service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:28.537038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cad49c-361c-4f4d-836f-b26d736ae3ec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:28.539273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cad49c-361c-4f4d-836f-b26d736ae3ec service glance] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:28.546824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 933/1893] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:28.558824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 961/1894] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:28 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:28.917359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ebb5-52c0-41ee-af24-c755aabdef2d service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:28.919553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3e82ebb5-52c0-41ee-af24-c755aabdef2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:28.934255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e82ebb5-52c0-41ee-af24-c755aabdef2d service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:28.940317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:28.941334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:28.941686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:28.942010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] PATH_INFO: `/v3/projects/bf4379509de14d9094d25fa0846cfa5e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:28.943278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf4379509de14d9094d25fa0846cfa5e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:28.945843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:29.103899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf4379509de14d9094d25fa0846cfa5e', 'request_id': 'req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.129064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf4379509de14d9094d25fa0846cfa5e', 'request_id': 'req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.141500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf4379509de14d9094d25fa0846cfa5e', 'request_id': 'req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.272551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] The token cache is being invalidate because project bf4379509de14d9094d25fa0846cfa5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:29.275825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.275825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.278699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 934/1895] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:28 2022] DELETE /identity/v3/projects/bf4379509de14d9094d25fa0846cfa5e => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:29.283271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cad49c-361c-4f4d-836f-b26d736ae3ec service glance] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:29.295495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cad49c-361c-4f4d-836f-b26d736ae3ec service glance] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:29.360796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:29.361853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:29.362236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:29.362592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] PATH_INFO: `/v3/users/e216a674bfde4dacbddc020a0dc68664` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:29.363899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e216a674bfde4dacbddc020a0dc68664)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:29.365977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:29.476348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:29.479868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:29.502076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf262d9-035d-4c1c-9821-ecfd4a2856b6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:29.515265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:29.517586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:29.517986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:29.519144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] PATH_INFO: `/v3/projects/9d1aa9b724694894897904866197a79c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:29.522898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d1aa9b724694894897904866197a79c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:29.531284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:29.624452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e216a674bfde4dacbddc020a0dc68664'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.681831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e216a674bfde4dacbddc020a0dc68664'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.753462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d1aa9b724694894897904866197a79c', 'request_id': 'req-ef02bb5b-036a-403e-852e-dae2a73eb2db'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.758314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e216a674bfde4dacbddc020a0dc68664'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.759554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e216a674bfde4dacbddc020a0dc68664'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.760133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e216a674bfde4dacbddc020a0dc68664'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.761061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d1aa9b724694894897904866197a79c', 'request_id': 'req-ef02bb5b-036a-403e-852e-dae2a73eb2db'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.776740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d1aa9b724694894897904866197a79c', 'request_id': 'req-ef02bb5b-036a-403e-852e-dae2a73eb2db'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.778272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 962/1896] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:29 2022] DELETE /identity/v3/users/e216a674bfde4dacbddc020a0dc68664 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:29.901451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] The token cache is being invalidate because project 9d1aa9b724694894897904866197a79c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:29.901755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.902406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:29.908260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 935/1897] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:29 2022] DELETE /identity/v3/projects/9d1aa9b724694894897904866197a79c => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:29.911173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:29.911173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:29.927447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:INSERT=3,keystone:DELETE=17,keystone:SELECT=80 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:29.994660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9485611e-babf-4018-a8cb-bf457134ace9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:30.002502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:30.003525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:30.003919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:30.004335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] PATH_INFO: `/v3/users/ab85d13764bf4fa3b1d50d2db5b17032` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:30.005800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab85d13764bf4fa3b1d50d2db5b17032)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:30.008229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:30.267948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=4,keystone:SELECT=96 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:30.279036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:30.283615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:30.320956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab85d13764bf4fa3b1d50d2db5b17032'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.343906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab85d13764bf4fa3b1d50d2db5b17032'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.418444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02bb5b-036a-403e-852e-dae2a73eb2db admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:30.423836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:30.424728 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:30.425066 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:30.425494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] PATH_INFO: `/v3/projects/fa133ffcf65a494d8f8c37d17a700a64` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:30.426878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa133ffcf65a494d8f8c37d17a700a64)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:30.428844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:30.461399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab85d13764bf4fa3b1d50d2db5b17032'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.462809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab85d13764bf4fa3b1d50d2db5b17032'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.463589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f4339af3-11cc-421c-a038-4dc83e2ba7e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab85d13764bf4fa3b1d50d2db5b17032'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.479528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 963/1898] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:29 2022] DELETE /identity/v3/users/ab85d13764bf4fa3b1d50d2db5b17032 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:30.545440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa133ffcf65a494d8f8c37d17a700a64', 'request_id': 'req-6d0a7134-3deb-4683-a2dd-d119fea23ec7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.554168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa133ffcf65a494d8f8c37d17a700a64', 'request_id': 'req-6d0a7134-3deb-4683-a2dd-d119fea23ec7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.561778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa133ffcf65a494d8f8c37d17a700a64', 'request_id': 'req-6d0a7134-3deb-4683-a2dd-d119fea23ec7'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.689865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] The token cache is being invalidate because project fa133ffcf65a494d8f8c37d17a700a64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:30.690212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.690807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d0a7134-3deb-4683-a2dd-d119fea23ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:30.692588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 936/1899] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:30 2022] DELETE /identity/v3/projects/fa133ffcf65a494d8f8c37d17a700a64 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:30.697874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd0cb1-4e7a-4d54-b4e1-2cacb3749b1c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:30.698364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd0cb1-4e7a-4d54-b4e1-2cacb3749b1c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:30.698479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd0cb1-4e7a-4d54-b4e1-2cacb3749b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:30.719106 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6ebd0cb1-4e7a-4d54-b4e1-2cacb3749b1c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:30.720566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6ebd0cb1-4e7a-4d54-b4e1-2cacb3749b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:30.858275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 964/1900] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:30.869480 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430578-7080-4af2-b0c7-ea6880c0e99b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:30.869480 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430578-7080-4af2-b0c7-ea6880c0e99b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:30.869480 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a430578-7080-4af2-b0c7-ea6880c0e99b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:30.900554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3a430578-7080-4af2-b0c7-ea6880c0e99b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:30.900554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3a430578-7080-4af2-b0c7-ea6880c0e99b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:30.913810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 937/1901] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:30.928154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd0cb1-4e7a-4d54-b4e1-2cacb3749b1c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:30.943373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebd0cb1-4e7a-4d54-b4e1-2cacb3749b1c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:30.967630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:30.969142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:30.969427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:30.969847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:30.971873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:30.976942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:30.980271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:30.995838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 965/1902] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:31.000771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a430578-7080-4af2-b0c7-ea6880c0e99b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.018759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a430578-7080-4af2-b0c7-ea6880c0e99b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.024649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5bae-ad6d-4d4d-bd1b-2b9d786910e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.025721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5bae-ad6d-4d4d-bd1b-2b9d786910e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.027159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5bae-ad6d-4d4d-bd1b-2b9d786910e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.027159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f5bae-ad6d-4d4d-bd1b-2b9d786910e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.027415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5bae-ad6d-4d4d-bd1b-2b9d786910e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.039290 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f5bae-ad6d-4d4d-bd1b-2b9d786910e4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:31.195355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.197228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 938/1903] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:30 2022] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:31.197653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:31.201437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5bae-ad6d-4d4d-bd1b-2b9d786910e4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.236332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce83f1bb-0eed-409a-8923-0b189e708953 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.277306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f5bae-ad6d-4d4d-bd1b-2b9d786910e4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.283176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03ef09-993f-4627-afd9-e2ca592b4a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.284080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03ef09-993f-4627-afd9-e2ca592b4a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.284458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03ef09-993f-4627-afd9-e2ca592b4a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.284864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03ef09-993f-4627-afd9-e2ca592b4a43 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.285671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03ef09-993f-4627-afd9-e2ca592b4a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.287658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03ef09-993f-4627-afd9-e2ca592b4a43 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:31.297525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.298397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.298758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.299045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] PATH_INFO: `/v3/projects/d1415e820fa24074ad543b8f0cc33f9f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.300260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1415e820fa24074ad543b8f0cc33f9f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.302218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:31.382258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 939/1904] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:31 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:31.386234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03ef09-993f-4627-afd9-e2ca592b4a43 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.397547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03ef09-993f-4627-afd9-e2ca592b4a43 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.398850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1415e820fa24074ad543b8f0cc33f9f', 'request_id': 'req-2ed886c0-b732-4cc6-abd8-271918271924'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:31.405333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1415e820fa24074ad543b8f0cc33f9f', 'request_id': 'req-2ed886c0-b732-4cc6-abd8-271918271924'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:31.411714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1415e820fa24074ad543b8f0cc33f9f', 'request_id': 'req-2ed886c0-b732-4cc6-abd8-271918271924'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:31.457240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:31.460823 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08707-0a6b-4125-beba-77109926af30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.461879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08707-0a6b-4125-beba-77109926af30 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.462254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08707-0a6b-4125-beba-77109926af30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.462538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d08707-0a6b-4125-beba-77109926af30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.463303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d08707-0a6b-4125-beba-77109926af30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.465272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d08707-0a6b-4125-beba-77109926af30 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:31.476501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 940/1905] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:31.480512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08707-0a6b-4125-beba-77109926af30 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.492634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d08707-0a6b-4125-beba-77109926af30 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.498184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615963fd-e6f3-4b53-bdba-de2cba941120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.498872 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615963fd-e6f3-4b53-bdba-de2cba941120 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.499151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615963fd-e6f3-4b53-bdba-de2cba941120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.500103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615963fd-e6f3-4b53-bdba-de2cba941120 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.500882 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615963fd-e6f3-4b53-bdba-de2cba941120 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.502534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615963fd-e6f3-4b53-bdba-de2cba941120 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:31.513205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 941/1906] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:31.517343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615963fd-e6f3-4b53-bdba-de2cba941120 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.523770 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] The token cache is being invalidate because project d1415e820fa24074ad543b8f0cc33f9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:31.524061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:31.524769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2ed886c0-b732-4cc6-abd8-271918271924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:31.526740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 966/1907] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:31 2022] DELETE /identity/v3/projects/d1415e820fa24074ad543b8f0cc33f9f => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:31.528652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615963fd-e6f3-4b53-bdba-de2cba941120 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.533089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c291a-5bfd-414e-9671-fca8470395aa None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.533593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c291a-5bfd-414e-9671-fca8470395aa None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.533873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9c291a-5bfd-414e-9671-fca8470395aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.534662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7db7e1-586b-4ffd-9d89-cb4e09677e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.535605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7db7e1-586b-4ffd-9d89-cb4e09677e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.535825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7db7e1-586b-4ffd-9d89-cb4e09677e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.536102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7db7e1-586b-4ffd-9d89-cb4e09677e8a admin admin] PATH_INFO: `/v3/projects/34794689062648708e912a21b9cfa829/users/6ac9111fcfc14829bbadfc92349943bc/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.554978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7db7e1-586b-4ffd-9d89-cb4e09677e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34794689062648708e912a21b9cfa829, user_id=6ac9111fcfc14829bbadfc92349943bc, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.556196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bf9c291a-5bfd-414e-9671-fca8470395aa None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:31.556753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bf9c291a-5bfd-414e-9671-fca8470395aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:31.557783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7db7e1-586b-4ffd-9d89-cb4e09677e8a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:31.566025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 967/1908] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:31.574804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ec2c8-d055-45fa-b371-e7fadec79af2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.575022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ec2c8-d055-45fa-b371-e7fadec79af2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.575302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ec2c8-d055-45fa-b371-e7fadec79af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.613671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ee8ec2c8-d055-45fa-b371-e7fadec79af2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:31.613914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ee8ec2c8-d055-45fa-b371-e7fadec79af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:31.623555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 968/1909] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:31.628295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ec2c8-d055-45fa-b371-e7fadec79af2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.639567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ec2c8-d055-45fa-b371-e7fadec79af2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.648172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 942/1910] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:31 2022] PUT /identity/v3/projects/34794689062648708e912a21b9cfa829/users/6ac9111fcfc14829bbadfc92349943bc/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:31.658244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034b36a-0d55-48f8-bbc0-4dc7edd4e4e0 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.658783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034b36a-0d55-48f8-bbc0-4dc7edd4e4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.659141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5034b36a-0d55-48f8-bbc0-4dc7edd4e4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.691739 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:31.693208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5034b36a-0d55-48f8-bbc0-4dc7edd4e4e0 None None] MFA Rules not processed for user `6ac9111fcfc14829bbadfc92349943bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:31.694465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5034b36a-0d55-48f8-bbc0-4dc7edd4e4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:31.722102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eba012-869d-4fdc-b3f6-62d169013d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.723973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba012-869d-4fdc-b3f6-62d169013d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.724879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba012-869d-4fdc-b3f6-62d169013d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.725238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eba012-869d-4fdc-b3f6-62d169013d1c admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.726070 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eba012-869d-4fdc-b3f6-62d169013d1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:31.726447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eba012-869d-4fdc-b3f6-62d169013d1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.728831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eba012-869d-4fdc-b3f6-62d169013d1c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:31.752153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 969/1911] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:31.753280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eba012-869d-4fdc-b3f6-62d169013d1c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.766395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eba012-869d-4fdc-b3f6-62d169013d1c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.773476 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a676-f522-4fb6-8426-8f11e1955241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.774037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a676-f522-4fb6-8426-8f11e1955241 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.777001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a676-f522-4fb6-8426-8f11e1955241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.777001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a676-f522-4fb6-8426-8f11e1955241 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.777218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 943/1912] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:31.777308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524a676-f522-4fb6-8426-8f11e1955241 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.777585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1524a676-f522-4fb6-8426-8f11e1955241 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:31.782991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034b36a-0d55-48f8-bbc0-4dc7edd4e4e0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.785451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5034b36a-0d55-48f8-bbc0-4dc7edd4e4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:31.800264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5034b36a-0d55-48f8-bbc0-4dc7edd4e4e0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.805327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155ba6f-4abb-4fcb-a5a3-be34868ccd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.805997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155ba6f-4abb-4fcb-a5a3-be34868ccd50 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.806283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155ba6f-4abb-4fcb-a5a3-be34868ccd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.812421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a155ba6f-4abb-4fcb-a5a3-be34868ccd50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.812421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155ba6f-4abb-4fcb-a5a3-be34868ccd50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.812421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a155ba6f-4abb-4fcb-a5a3-be34868ccd50 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:31.875321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 970/1913] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:31 2022] POST /identity/v3/projects => generated 401 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:31.879132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a676-f522-4fb6-8426-8f11e1955241 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.910143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 944/1914] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:31 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:31.914078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155ba6f-4abb-4fcb-a5a3-be34868ccd50 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:31.951527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a676-f522-4fb6-8426-8f11e1955241 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.983399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a155ba6f-4abb-4fcb-a5a3-be34868ccd50 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:31.990019 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d893829-e316-4c26-b4d0-d31bc03f43fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:31.990705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d893829-e316-4c26-b4d0-d31bc03f43fa admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:31.991020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d893829-e316-4c26-b4d0-d31bc03f43fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:31.991304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d893829-e316-4c26-b4d0-d31bc03f43fa admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:31.992018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d893829-e316-4c26-b4d0-d31bc03f43fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:31.993983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d893829-e316-4c26-b4d0-d31bc03f43fa admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.017711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db4b41-4134-4e69-ac0b-f4e1bfd27afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:32.018393 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db4b41-4134-4e69-ac0b-f4e1bfd27afa admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.018677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db4b41-4134-4e69-ac0b-f4e1bfd27afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.018961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db4b41-4134-4e69-ac0b-f4e1bfd27afa admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.019878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db4b41-4134-4e69-ac0b-f4e1bfd27afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:32.022343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db4b41-4134-4e69-ac0b-f4e1bfd27afa admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.177252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 971/1916] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:31 2022] POST /identity/v3/users => generated 301 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:32.177437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 945/1916] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:31 2022] POST /identity/v3/users => generated 300 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:32.181265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db4b41-4134-4e69-ac0b-f4e1bfd27afa admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:32.181414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d893829-e316-4c26-b4d0-d31bc03f43fa admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:32.195487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d893829-e316-4c26-b4d0-d31bc03f43fa admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:32.197743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db4b41-4134-4e69-ac0b-f4e1bfd27afa admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:32.200458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3492021-1647-48b0-a7f4-e5cab8e62ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:32.201165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3492021-1647-48b0-a7f4-e5cab8e62ebc admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.201478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3492021-1647-48b0-a7f4-e5cab8e62ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.201756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3492021-1647-48b0-a7f4-e5cab8e62ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.202808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3492021-1647-48b0-a7f4-e5cab8e62ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:32.203693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29cf07-e859-473e-9352-e8e182fcd188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:32.204450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29cf07-e859-473e-9352-e8e182fcd188 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.204586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3492021-1647-48b0-a7f4-e5cab8e62ebc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.204768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29cf07-e859-473e-9352-e8e182fcd188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.205041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b29cf07-e859-473e-9352-e8e182fcd188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.205849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29cf07-e859-473e-9352-e8e182fcd188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:32.207623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b29cf07-e859-473e-9352-e8e182fcd188 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.217646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 946/1917] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:37:32.221764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 972/1918] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:32.238530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3492021-1647-48b0-a7f4-e5cab8e62ebc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:32.238706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29cf07-e859-473e-9352-e8e182fcd188 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:32.269567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3492021-1647-48b0-a7f4-e5cab8e62ebc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:32.270067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b29cf07-e859-473e-9352-e8e182fcd188 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:32.270316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53be298-9a7e-4aa0-b98a-b410c33c21bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:32.270316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53be298-9a7e-4aa0-b98a-b410c33c21bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.270316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53be298-9a7e-4aa0-b98a-b410c33c21bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.270691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7cfd5-9678-4160-b6a0-cd052f64675d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:32.270825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53be298-9a7e-4aa0-b98a-b410c33c21bf admin admin] PATH_INFO: `/v3/projects/a68628de01504760bd59a2688e396920/users/0bb975b6ab9046308e828df58cea5c5e/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.270920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7cfd5-9678-4160-b6a0-cd052f64675d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.270920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7cfd5-9678-4160-b6a0-cd052f64675d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.270920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7cfd5-9678-4160-b6a0-cd052f64675d admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.270920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7cfd5-9678-4160-b6a0-cd052f64675d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:32.270920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7cfd5-9678-4160-b6a0-cd052f64675d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.278100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 973/1919] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:32.282083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53be298-9a7e-4aa0-b98a-b410c33c21bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68628de01504760bd59a2688e396920, user_id=0bb975b6ab9046308e828df58cea5c5e, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:32.284138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7cfd5-9678-4160-b6a0-cd052f64675d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:32.284669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53be298-9a7e-4aa0-b98a-b410c33c21bf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.295113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7cfd5-9678-4160-b6a0-cd052f64675d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:32.300618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c0e6a-aec9-46f1-ac7e-0b5e9ac900a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:32.301542 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c0e6a-aec9-46f1-ac7e-0b5e9ac900a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.301828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c0e6a-aec9-46f1-ac7e-0b5e9ac900a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.302134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623c0e6a-aec9-46f1-ac7e-0b5e9ac900a9 admin admin] PATH_INFO: `/v3/projects/95f0e451b0f44920831e8c653420686c/users/4b52918bf0bd4731bd11a641a129f402/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.319387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c0e6a-aec9-46f1-ac7e-0b5e9ac900a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f0e451b0f44920831e8c653420686c, user_id=4b52918bf0bd4731bd11a641a129f402, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:32.322141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623c0e6a-aec9-46f1-ac7e-0b5e9ac900a9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.752996 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 974/1920] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:32 2022] PUT /identity/v3/projects/95f0e451b0f44920831e8c653420686c/users/4b52918bf0bd4731bd11a641a129f402/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:32.753574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 947/1921] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:32 2022] PUT /identity/v3/projects/a68628de01504760bd59a2688e396920/users/0bb975b6ab9046308e828df58cea5c5e/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:32.754748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c0e6a-aec9-46f1-ac7e-0b5e9ac900a9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:32.757079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a485e-1a8d-41bd-9a1c-fdb5d76ac299 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.757388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a485e-1a8d-41bd-9a1c-fdb5d76ac299 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.757740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a485e-1a8d-41bd-9a1c-fdb5d76ac299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.790089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d81a485e-1a8d-41bd-9a1c-fdb5d76ac299 None None] MFA Rules not processed for user `4b52918bf0bd4731bd11a641a129f402`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:32.801275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d81a485e-1a8d-41bd-9a1c-fdb5d76ac299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:32.824850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623c0e6a-aec9-46f1-ac7e-0b5e9ac900a9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:32.870776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 948/1922] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:32.875234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a485e-1a8d-41bd-9a1c-fdb5d76ac299 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:32.893447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac816c-4e14-4bed-9dc3-a7819a8c3d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:32.894224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac816c-4e14-4bed-9dc3-a7819a8c3d8b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.894799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac816c-4e14-4bed-9dc3-a7819a8c3d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.894961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fac816c-4e14-4bed-9dc3-a7819a8c3d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.895752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac816c-4e14-4bed-9dc3-a7819a8c3d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:32.897485 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fac816c-4e14-4bed-9dc3-a7819a8c3d8b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.912733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 975/1923] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:32 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:32.923155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac816c-4e14-4bed-9dc3-a7819a8c3d8b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:32.934625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fac816c-4e14-4bed-9dc3-a7819a8c3d8b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:32.939668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4bc75-e2d3-4993-b640-485c8477d95b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:32.940604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4bc75-e2d3-4993-b640-485c8477d95b admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.940902 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4bc75-e2d3-4993-b640-485c8477d95b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.941184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4bc75-e2d3-4993-b640-485c8477d95b admin admin] PATH_INFO: `/v3/projects/a68628de01504760bd59a2688e396920/users/0bb975b6ab9046308e828df58cea5c5e/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.943525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4bc75-e2d3-4993-b640-485c8477d95b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a68628de01504760bd59a2688e396920, user_id=0bb975b6ab9046308e828df58cea5c5e, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:32.946245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c4bc75-e2d3-4993-b640-485c8477d95b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.947739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a485e-1a8d-41bd-9a1c-fdb5d76ac299 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:32.953720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e842cdc-be96-45d8-92b6-c60c793dc1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:32.954479 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842cdc-be96-45d8-92b6-c60c793dc1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.954838 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842cdc-be96-45d8-92b6-c60c793dc1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.955088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e842cdc-be96-45d8-92b6-c60c793dc1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:32.955793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e842cdc-be96-45d8-92b6-c60c793dc1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:32.960530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 976/1924] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:32 2022] PUT /identity/v3/projects/a68628de01504760bd59a2688e396920/users/0bb975b6ab9046308e828df58cea5c5e/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:32.960704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e842cdc-be96-45d8-92b6-c60c793dc1cc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:32.969645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399950da-4bfd-4f23-908e-8a069c183746 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:32.974621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399950da-4bfd-4f23-908e-8a069c183746 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:32.974621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399950da-4bfd-4f23-908e-8a069c183746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:33.001579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-399950da-4bfd-4f23-908e-8a069c183746 None None] MFA Rules not processed for user `0bb975b6ab9046308e828df58cea5c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:33.002782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-399950da-4bfd-4f23-908e-8a069c183746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:33.052543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 949/1925] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:32 2022] POST /identity/v3/projects => generated 401 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:33.056658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e842cdc-be96-45d8-92b6-c60c793dc1cc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:33.080655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 977/1926] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:32 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:33.090293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399950da-4bfd-4f23-908e-8a069c183746 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:33.091677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-399950da-4bfd-4f23-908e-8a069c183746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:33.127446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e842cdc-be96-45d8-92b6-c60c793dc1cc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:33.133298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2cf7-df12-40c9-b1af-5493f9d00cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:33.134428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2cf7-df12-40c9-b1af-5493f9d00cbb admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:33.134554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2cf7-df12-40c9-b1af-5493f9d00cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:33.134743 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35c2cf7-df12-40c9-b1af-5493f9d00cbb admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:33.135699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c2cf7-df12-40c9-b1af-5493f9d00cbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:33.137775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35c2cf7-df12-40c9-b1af-5493f9d00cbb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:33.149896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399950da-4bfd-4f23-908e-8a069c183746 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:33.198256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752eb566-c340-4ee5-ba34-d1d339b04b3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:33.199023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752eb566-c340-4ee5-ba34-d1d339b04b3f service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:33.199306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752eb566-c340-4ee5-ba34-d1d339b04b3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:33.199579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752eb566-c340-4ee5-ba34-d1d339b04b3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:33.262801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752eb566-c340-4ee5-ba34-d1d339b04b3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:33.264206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752eb566-c340-4ee5-ba34-d1d339b04b3f service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:33.268140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 950/1927] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:33 2022] POST /identity/v3/users => generated 307 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:33.272212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2cf7-df12-40c9-b1af-5493f9d00cbb admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:33.275423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 978/1928] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:33.281739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35c2cf7-df12-40c9-b1af-5493f9d00cbb admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:33.286338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249ce5b-b320-4d0f-b405-9dfb99329dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:33.286999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249ce5b-b320-4d0f-b405-9dfb99329dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:33.287281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249ce5b-b320-4d0f-b405-9dfb99329dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:33.287554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b249ce5b-b320-4d0f-b405-9dfb99329dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:33.288279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249ce5b-b320-4d0f-b405-9dfb99329dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:33.289886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b249ce5b-b320-4d0f-b405-9dfb99329dc5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:33.300209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 951/1929] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:37:33.302094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:33.304274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752eb566-c340-4ee5-ba34-d1d339b04b3f service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:33.315056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752eb566-c340-4ee5-ba34-d1d339b04b3f service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:33.321138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991287cc-e1cb-4f5c-a000-e82a42b71610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:33.322060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991287cc-e1cb-4f5c-a000-e82a42b71610 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:33.322337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991287cc-e1cb-4f5c-a000-e82a42b71610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:33.322608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991287cc-e1cb-4f5c-a000-e82a42b71610 admin admin] PATH_INFO: `/v3/projects/987d2ca035c4417ab965706c899fb951/users/bf513343bc07463ba9920fa2ef5d8b73/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:33.338430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991287cc-e1cb-4f5c-a000-e82a42b71610 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987d2ca035c4417ab965706c899fb951, user_id=bf513343bc07463ba9920fa2ef5d8b73, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:33.341389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991287cc-e1cb-4f5c-a000-e82a42b71610 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:33.433797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 979/1930] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:33 2022] PUT /identity/v3/projects/987d2ca035c4417ab965706c899fb951/users/bf513343bc07463ba9920fa2ef5d8b73/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:33.438407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249ce5b-b320-4d0f-b405-9dfb99329dc5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:33.454433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b249ce5b-b320-4d0f-b405-9dfb99329dc5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:33.527383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dd6d8-1306-4cc0-a383-c36cd980b0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:33.528151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dd6d8-1306-4cc0-a383-c36cd980b0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:33.528338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dd6d8-1306-4cc0-a383-c36cd980b0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:33.528671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dd6d8-1306-4cc0-a383-c36cd980b0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:33.529404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dd6d8-1306-4cc0-a383-c36cd980b0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:33.531154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dd6d8-1306-4cc0-a383-c36cd980b0f6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:33.541559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 952/1931] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:37:33.545691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991287cc-e1cb-4f5c-a000-e82a42b71610 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:33.560809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991287cc-e1cb-4f5c-a000-e82a42b71610 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:33.570598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a4b3-549a-48ed-bcec-464e7f38f8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:33.571584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a4b3-549a-48ed-bcec-464e7f38f8e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:33.571990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a4b3-549a-48ed-bcec-464e7f38f8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:33.572384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a1a4b3-549a-48ed-bcec-464e7f38f8e4 admin admin] PATH_INFO: `/v3/projects/987d2ca035c4417ab965706c899fb951/users/bf513343bc07463ba9920fa2ef5d8b73/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:33.574608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1a4b3-549a-48ed-bcec-464e7f38f8e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987d2ca035c4417ab965706c899fb951, user_id=bf513343bc07463ba9920fa2ef5d8b73, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:33.577370 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a1a4b3-549a-48ed-bcec-464e7f38f8e4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:33.605806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 980/1932] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:33 2022] PUT /identity/v3/projects/987d2ca035c4417ab965706c899fb951/users/bf513343bc07463ba9920fa2ef5d8b73/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:33.617839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b0d7e-748b-4616-97ad-c874fa2d5a86 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:33.618223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b0d7e-748b-4616-97ad-c874fa2d5a86 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:33.622942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b0d7e-748b-4616-97ad-c874fa2d5a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:33.654441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-551b0d7e-748b-4616-97ad-c874fa2d5a86 None None] MFA Rules not processed for user `bf513343bc07463ba9920fa2ef5d8b73`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:33.655039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-551b0d7e-748b-4616-97ad-c874fa2d5a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:33.695827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:33.731018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 953/1933] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:33 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:33.744619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a4b3-549a-48ed-bcec-464e7f38f8e4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:33.815045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a1a4b3-549a-48ed-bcec-464e7f38f8e4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:33.818962 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d257d-fd1b-4786-a9b5-1a4aba89f57f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:33.819612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d257d-fd1b-4786-a9b5-1a4aba89f57f service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:33.819895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d257d-fd1b-4786-a9b5-1a4aba89f57f service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:33.820167 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2d257d-fd1b-4786-a9b5-1a4aba89f57f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:33.829384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d257d-fd1b-4786-a9b5-1a4aba89f57f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:33.830988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2d257d-fd1b-4786-a9b5-1a4aba89f57f service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:33.840403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 981/1934] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:33 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:34.147773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b0d7e-748b-4616-97ad-c874fa2d5a86 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:34.149170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-551b0d7e-748b-4616-97ad-c874fa2d5a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:34.165176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551b0d7e-748b-4616-97ad-c874fa2d5a86 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:34.168863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49923950-2008-4e3d-8ff5-5e5d383affce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:34.169745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49923950-2008-4e3d-8ff5-5e5d383affce service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:34.169949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49923950-2008-4e3d-8ff5-5e5d383affce service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:34.170231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49923950-2008-4e3d-8ff5-5e5d383affce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:34.264108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49923950-2008-4e3d-8ff5-5e5d383affce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:34.264108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49923950-2008-4e3d-8ff5-5e5d383affce service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:34.272661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 954/1935] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:34 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:34.683955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d257d-fd1b-4786-a9b5-1a4aba89f57f service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:34.780170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2d257d-fd1b-4786-a9b5-1a4aba89f57f service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:34.787597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:34.788878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:34.789134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:34.789367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] PATH_INFO: `/v3/users/6ac9111fcfc14829bbadfc92349943bc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:34.790578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ac9111fcfc14829bbadfc92349943bc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:34.792547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:35.052200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ac9111fcfc14829bbadfc92349943bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:35.068899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ac9111fcfc14829bbadfc92349943bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:35.157089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ac9111fcfc14829bbadfc92349943bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:35.158629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ac9111fcfc14829bbadfc92349943bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:35.159311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ac9111fcfc14829bbadfc92349943bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:35.172788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 982/1936] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:34 2022] DELETE /identity/v3/users/6ac9111fcfc14829bbadfc92349943bc => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:35.178452 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef0da9-50ad-4beb-ae4d-a65cc7e30234 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:35.178910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef0da9-50ad-4beb-ae4d-a65cc7e30234 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:35.179008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef0da9-50ad-4beb-ae4d-a65cc7e30234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:35.198485 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b7ef0da9-50ad-4beb-ae4d-a65cc7e30234 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:35.200247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b7ef0da9-50ad-4beb-ae4d-a65cc7e30234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:35.221954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:35.272686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 955/1937] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:35.278191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:35.279649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:35.339994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5e68-8a2c-428e-98a5-6f6c64b8b166 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:35.344181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac101-853e-4094-a6ab-20337c035e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:35.344895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac101-853e-4094-a6ab-20337c035e09 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:35.345200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac101-853e-4094-a6ab-20337c035e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:35.345673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854ac101-853e-4094-a6ab-20337c035e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:35.355100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ac101-853e-4094-a6ab-20337c035e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:35.356452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854ac101-853e-4094-a6ab-20337c035e09 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:35.366811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 983/1938] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:35.593944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:35.900686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef0da9-50ad-4beb-ae4d-a65cc7e30234 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:35.900686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b7ef0da9-50ad-4beb-ae4d-a65cc7e30234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:35.917564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef0da9-50ad-4beb-ae4d-a65cc7e30234 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:35.925218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:35.926106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:35.926390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:35.926714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] PATH_INFO: `/v3/projects/34794689062648708e912a21b9cfa829` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:35.927981 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34794689062648708e912a21b9cfa829)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:35.930017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:36.081687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34794689062648708e912a21b9cfa829', 'request_id': 'req-f57facf3-1362-4611-b1ac-9578ab677866'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.091167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34794689062648708e912a21b9cfa829', 'request_id': 'req-f57facf3-1362-4611-b1ac-9578ab677866'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.097879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34794689062648708e912a21b9cfa829', 'request_id': 'req-f57facf3-1362-4611-b1ac-9578ab677866'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.266998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] The token cache is being invalidate because project 34794689062648708e912a21b9cfa829 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:36.267705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.267908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.269503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 956/1939] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:35 2022] DELETE /identity/v3/projects/34794689062648708e912a21b9cfa829 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:36.273874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac101-853e-4094-a6ab-20337c035e09 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:36.284396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854ac101-853e-4094-a6ab-20337c035e09 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:36.346059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:36.346939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:36.347223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:36.347500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] PATH_INFO: `/v3/users/0bb975b6ab9046308e828df58cea5c5e` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:36.348728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0bb975b6ab9046308e828df58cea5c5e)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:36.350829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:36.558358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0bb975b6ab9046308e828df58cea5c5e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.573603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0bb975b6ab9046308e828df58cea5c5e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.724413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0bb975b6ab9046308e828df58cea5c5e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.725092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0bb975b6ab9046308e828df58cea5c5e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.725719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c85807d-082c-4891-97f2-3cacc037904a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0bb975b6ab9046308e828df58cea5c5e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:36.739179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 984/1940] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:36 2022] DELETE /identity/v3/users/0bb975b6ab9046308e828df58cea5c5e => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:36.873807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:37.303861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:37.305905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:37.321161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57facf3-1362-4611-b1ac-9578ab677866 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:37.392130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:37.393667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:37.394166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:37.394615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] PATH_INFO: `/v3/projects/a68628de01504760bd59a2688e396920` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:37.397204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a68628de01504760bd59a2688e396920)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:37.400517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:37.533740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a68628de01504760bd59a2688e396920', 'request_id': 'req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:37.540444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a68628de01504760bd59a2688e396920', 'request_id': 'req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:37.547849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a68628de01504760bd59a2688e396920', 'request_id': 'req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:37.621549 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] The token cache is being invalidate because project a68628de01504760bd59a2688e396920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:37.621846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:37.622505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b7e21d46-b891-4f7f-b6a7-b4e2710cff31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:37.624109 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 957/1941] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:37 2022] DELETE /identity/v3/projects/a68628de01504760bd59a2688e396920 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:37.630180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60059-b1d2-43b3-a1c3-93c6b1512539 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:37.630674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60059-b1d2-43b3-a1c3-93c6b1512539 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:37.630792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60059-b1d2-43b3-a1c3-93c6b1512539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:37.654669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-18c60059-b1d2-43b3-a1c3-93c6b1512539 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:37.656198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-18c60059-b1d2-43b3-a1c3-93c6b1512539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:37.722759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 985/1942] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:37.732077 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f4d38-039f-4cef-a039-14d7beace84b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:37.732648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f4d38-039f-4cef-a039-14d7beace84b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:37.733093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f4d38-039f-4cef-a039-14d7beace84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:37.752821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-758f4d38-039f-4cef-a039-14d7beace84b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:37.754024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-758f4d38-039f-4cef-a039-14d7beace84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:37.762334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 958/1943] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:37.766832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60059-b1d2-43b3-a1c3-93c6b1512539 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:37.776158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:37.779087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60059-b1d2-43b3-a1c3-93c6b1512539 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:37.784448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b742c3-e0f6-45b6-b4ee-1d1cd8231425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:37.785143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b742c3-e0f6-45b6-b4ee-1d1cd8231425 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:37.785431 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b742c3-e0f6-45b6-b4ee-1d1cd8231425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:37.785706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b742c3-e0f6-45b6-b4ee-1d1cd8231425 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:37.786468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b742c3-e0f6-45b6-b4ee-1d1cd8231425 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:37.786788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b742c3-e0f6-45b6-b4ee-1d1cd8231425 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:37.788404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b742c3-e0f6-45b6-b4ee-1d1cd8231425 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:37.801610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 986/1944] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:37.805735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f4d38-039f-4cef-a039-14d7beace84b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:37.815443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f4d38-039f-4cef-a039-14d7beace84b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:37.820632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91fce-1885-4a3f-bd01-d02bc514f3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:37.821524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91fce-1885-4a3f-bd01-d02bc514f3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:37.822120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91fce-1885-4a3f-bd01-d02bc514f3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:37.822472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc91fce-1885-4a3f-bd01-d02bc514f3b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:37.823637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91fce-1885-4a3f-bd01-d02bc514f3b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:37.826380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc91fce-1885-4a3f-bd01-d02bc514f3b5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:37.943148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 959/1945] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:37 2022] POST /identity/v3/projects => generated 361 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:37.947491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b742c3-e0f6-45b6-b4ee-1d1cd8231425 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:37.960659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b742c3-e0f6-45b6-b4ee-1d1cd8231425 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:38.023464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa243-462b-47b8-ad98-807d1744e7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:38.024149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa243-462b-47b8-ad98-807d1744e7be admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:38.024621 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa243-462b-47b8-ad98-807d1744e7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:38.024903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951fa243-462b-47b8-ad98-807d1744e7be admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:38.025792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fa243-462b-47b8-ad98-807d1744e7be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:38.029649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951fa243-462b-47b8-ad98-807d1744e7be admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:38.166025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 987/1946] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:37 2022] POST /identity/v3/users => generated 281 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:38.170193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91fce-1885-4a3f-bd01-d02bc514f3b5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:38.181194 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc91fce-1885-4a3f-bd01-d02bc514f3b5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:38.186026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d0acb-d9a0-4e78-a707-a53627708135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:38.187247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d0acb-d9a0-4e78-a707-a53627708135 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:38.187769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d0acb-d9a0-4e78-a707-a53627708135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:38.188086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d0acb-d9a0-4e78-a707-a53627708135 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:38.189417 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d0acb-d9a0-4e78-a707-a53627708135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:38.191462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d0acb-d9a0-4e78-a707-a53627708135 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:38.203214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 960/1947] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:38.207437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa243-462b-47b8-ad98-807d1744e7be admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:38.218199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951fa243-462b-47b8-ad98-807d1744e7be admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:38.223585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cd778-96e1-45be-8b32-6df66fe1a25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:38.224202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cd778-96e1-45be-8b32-6df66fe1a25d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:38.224502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cd778-96e1-45be-8b32-6df66fe1a25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:38.224834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cd778-96e1-45be-8b32-6df66fe1a25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:38.225577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cd778-96e1-45be-8b32-6df66fe1a25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:38.227192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cd778-96e1-45be-8b32-6df66fe1a25d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:38.241390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 988/1948] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:38.242550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d0acb-d9a0-4e78-a707-a53627708135 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:38.253180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d0acb-d9a0-4e78-a707-a53627708135 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:38.257908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72dcb-b1de-4e7a-9edf-1b8804d6f7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:38.258808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72dcb-b1de-4e7a-9edf-1b8804d6f7b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:38.259059 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72dcb-b1de-4e7a-9edf-1b8804d6f7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:38.259329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc72dcb-b1de-4e7a-9edf-1b8804d6f7b1 admin admin] PATH_INFO: `/v3/projects/ebd9f7cb427e4a26a8dd476ec2981b04/users/d159e40a40e6457c87b1fd63a9059fac/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:38.275408 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72dcb-b1de-4e7a-9edf-1b8804d6f7b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebd9f7cb427e4a26a8dd476ec2981b04, user_id=d159e40a40e6457c87b1fd63a9059fac, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:38.278168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc72dcb-b1de-4e7a-9edf-1b8804d6f7b1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:38.376497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 961/1949] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:38 2022] PUT /identity/v3/projects/ebd9f7cb427e4a26a8dd476ec2981b04/users/d159e40a40e6457c87b1fd63a9059fac/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:38.386859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689499a5-224f-4712-855e-9ede5101cd79 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:38.387149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689499a5-224f-4712-855e-9ede5101cd79 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:38.387426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689499a5-224f-4712-855e-9ede5101cd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:38.420457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-689499a5-224f-4712-855e-9ede5101cd79 None None] MFA Rules not processed for user `d159e40a40e6457c87b1fd63a9059fac`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:38.422741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-689499a5-224f-4712-855e-9ede5101cd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:38.499978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 989/1950] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:38.549411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72dcb-b1de-4e7a-9edf-1b8804d6f7b1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:38.551317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8cc72dcb-b1de-4e7a-9edf-1b8804d6f7b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:38.612213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc72dcb-b1de-4e7a-9edf-1b8804d6f7b1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:38.618893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc83a8f-1843-4b67-938e-db8b75af2129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:38.618893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc83a8f-1843-4b67-938e-db8b75af2129 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:38.618893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc83a8f-1843-4b67-938e-db8b75af2129 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:38.618893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc83a8f-1843-4b67-938e-db8b75af2129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:38.627888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc83a8f-1843-4b67-938e-db8b75af2129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:38.629360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc83a8f-1843-4b67-938e-db8b75af2129 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:38.638185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 962/1951] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:38.653428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689499a5-224f-4712-855e-9ede5101cd79 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:38.690220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:38.718205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689499a5-224f-4712-855e-9ede5101cd79 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:38.723034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:38.723958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:38.724237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:38.725265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] PATH_INFO: `/v3/users/d159e40a40e6457c87b1fd63a9059fac` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:38.725807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d159e40a40e6457c87b1fd63a9059fac)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:38.727733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:39.048178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd159e40a40e6457c87b1fd63a9059fac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:39.062741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd159e40a40e6457c87b1fd63a9059fac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:39.141543 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd159e40a40e6457c87b1fd63a9059fac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:39.142178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd159e40a40e6457c87b1fd63a9059fac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:39.142837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd159e40a40e6457c87b1fd63a9059fac'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:39.156964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 990/1952] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:38 2022] DELETE /identity/v3/users/d159e40a40e6457c87b1fd63a9059fac => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:39.161531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca29a2-325b-486f-bc1b-efffc1c7fb4b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:39.161934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca29a2-325b-486f-bc1b-efffc1c7fb4b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:39.162284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca29a2-325b-486f-bc1b-efffc1c7fb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:39.181174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-11ca29a2-325b-486f-bc1b-efffc1c7fb4b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:39.182625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-11ca29a2-325b-486f-bc1b-efffc1c7fb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:39.258434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 963/1953] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:39.269180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:39.270913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:39.336848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d7161-ecd3-4f7d-9658-1f72f778504a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:39.340777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f358-9c6a-470f-9c76-a06318aa85d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:39.341646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f358-9c6a-470f-9c76-a06318aa85d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:39.341928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f358-9c6a-470f-9c76-a06318aa85d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:39.342295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0f358-9c6a-470f-9c76-a06318aa85d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:39.352989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0f358-9c6a-470f-9c76-a06318aa85d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:39.354666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0f358-9c6a-470f-9c76-a06318aa85d4 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:39.365212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 991/1954] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:39.709064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:39.838738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca29a2-325b-486f-bc1b-efffc1c7fb4b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:39.840460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-11ca29a2-325b-486f-bc1b-efffc1c7fb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:39.856758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca29a2-325b-486f-bc1b-efffc1c7fb4b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:39.861414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:39.862294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:39.862577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:39.862853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] PATH_INFO: `/v3/users/4b52918bf0bd4731bd11a641a129f402` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:39.864065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b52918bf0bd4731bd11a641a129f402)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:39.866131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:39.920657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f358-9c6a-470f-9c76-a06318aa85d4 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:39.923666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3af0f358-9c6a-470f-9c76-a06318aa85d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:39.959951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0f358-9c6a-470f-9c76-a06318aa85d4 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:39.961263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:39.962154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:39.962449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:39.962796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] PATH_INFO: `/v3/projects/ebd9f7cb427e4a26a8dd476ec2981b04` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:39.964126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebd9f7cb427e4a26a8dd476ec2981b04)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:39.967294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:40.081085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b52918bf0bd4731bd11a641a129f402'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.085105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebd9f7cb427e4a26a8dd476ec2981b04', 'request_id': 'req-19d6ea1a-4d65-4811-979c-256430ec6925'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.088196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b52918bf0bd4731bd11a641a129f402'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.089305 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b52918bf0bd4731bd11a641a129f402'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.091929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebd9f7cb427e4a26a8dd476ec2981b04', 'request_id': 'req-19d6ea1a-4d65-4811-979c-256430ec6925'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.098459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebd9f7cb427e4a26a8dd476ec2981b04', 'request_id': 'req-19d6ea1a-4d65-4811-979c-256430ec6925'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.107511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b52918bf0bd4731bd11a641a129f402'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.108779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-04d7a0c5-8b2a-4761-a9fb-58e2cd537887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b52918bf0bd4731bd11a641a129f402'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.193200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] The token cache is being invalidate because project ebd9f7cb427e4a26a8dd476ec2981b04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:40.193486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.194159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19d6ea1a-4d65-4811-979c-256430ec6925 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.195717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 992/1955] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:39 2022] DELETE /identity/v3/projects/ebd9f7cb427e4a26a8dd476ec2981b04 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:40.197118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ceb68b-2288-4a1a-a1c1-97a2c567839b None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.197435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ceb68b-2288-4a1a-a1c1-97a2c567839b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.197720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ceb68b-2288-4a1a-a1c1-97a2c567839b None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.199118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 993/1956] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:37:40.199862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ceb68b-2288-4a1a-a1c1-97a2c567839b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:40.201559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f7ceb68b-2288-4a1a-a1c1-97a2c567839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:40.272126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ceb68b-2288-4a1a-a1c1-97a2c567839b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:40.276851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:40.277717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.277993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.278263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] PATH_INFO: `/v3/users/107da1af788341e4817a7038495f050c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.279521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=107da1af788341e4817a7038495f050c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:40.282188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:40.291499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 964/1957] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:39 2022] DELETE /identity/v3/users/4b52918bf0bd4731bd11a641a129f402 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:40.298956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd2f6a-c5f9-4636-9e8b-dfaac74b6c32 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.298956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd2f6a-c5f9-4636-9e8b-dfaac74b6c32 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.298956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd2f6a-c5f9-4636-9e8b-dfaac74b6c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.312531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-50fd2f6a-c5f9-4636-9e8b-dfaac74b6c32 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:40.313733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-50fd2f6a-c5f9-4636-9e8b-dfaac74b6c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:40.377960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 965/1958] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:40.379451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0a90a-70f4-49c3-a634-03341308372a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.379746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0a90a-70f4-49c3-a634-03341308372a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.380022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0a90a-70f4-49c3-a634-03341308372a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.401524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-80c0a90a-70f4-49c3-a634-03341308372a None None] MFA Rules not processed for user `762b38d08d2447bfbc968245a5b2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:40.402735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-80c0a90a-70f4-49c3-a634-03341308372a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:40.471611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 966/1959] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:37:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:40.473074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadea75-f941-4bd5-a2fa-c4bdea1e1092 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.473424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadea75-f941-4bd5-a2fa-c4bdea1e1092 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.473777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfadea75-f941-4bd5-a2fa-c4bdea1e1092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.492786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-cfadea75-f941-4bd5-a2fa-c4bdea1e1092 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:40.494180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cfadea75-f941-4bd5-a2fa-c4bdea1e1092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:40.505502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 967/1960] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:40.507188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22287b90-fb40-4a8c-beb8-2f11842e3f3a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.507559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22287b90-fb40-4a8c-beb8-2f11842e3f3a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.507878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22287b90-fb40-4a8c-beb8-2f11842e3f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.528300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-22287b90-fb40-4a8c-beb8-2f11842e3f3a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:40.529515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-22287b90-fb40-4a8c-beb8-2f11842e3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:40.537330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 968/1961] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:40.542513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22287b90-fb40-4a8c-beb8-2f11842e3f3a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:40.542513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-22287b90-fb40-4a8c-beb8-2f11842e3f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:40.557105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22287b90-fb40-4a8c-beb8-2f11842e3f3a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:40.563012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcf6fc-dc60-4e0d-9816-3f16089804b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:40.563681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcf6fc-dc60-4e0d-9816-3f16089804b3 service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.563963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcf6fc-dc60-4e0d-9816-3f16089804b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.564237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dcf6fc-dc60-4e0d-9816-3f16089804b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.572705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcf6fc-dc60-4e0d-9816-3f16089804b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:40.574273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dcf6fc-dc60-4e0d-9816-3f16089804b3 service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:40.585916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 969/1962] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:40.586674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcf6fc-dc60-4e0d-9816-3f16089804b3 service placement] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:40.588032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-81dcf6fc-dc60-4e0d-9816-3f16089804b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:40.638091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '107da1af788341e4817a7038495f050c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.649602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dcf6fc-dc60-4e0d-9816-3f16089804b3 service placement] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:40.651191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '107da1af788341e4817a7038495f050c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.654134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2a76-c602-47c2-86ac-b814d508c083 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:40.654974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2a76-c602-47c2-86ac-b814d508c083 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.655334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2a76-c602-47c2-86ac-b814d508c083 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.655700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a2a76-c602-47c2-86ac-b814d508c083 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.666400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a2a76-c602-47c2-86ac-b814d508c083 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:40.667962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a2a76-c602-47c2-86ac-b814d508c083 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:40.678464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 970/1963] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:40.682184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2a76-c602-47c2-86ac-b814d508c083 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:40.690279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a2a76-c602-47c2-86ac-b814d508c083 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:40.695764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec85d-620d-41b9-b237-2cf0b9021dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:40.696580 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec85d-620d-41b9-b237-2cf0b9021dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.697017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec85d-620d-41b9-b237-2cf0b9021dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.697348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bec85d-620d-41b9-b237-2cf0b9021dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.698267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bec85d-620d-41b9-b237-2cf0b9021dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:40.720131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bec85d-620d-41b9-b237-2cf0b9021dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:40.720131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bec85d-620d-41b9-b237-2cf0b9021dd9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:40.720131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 971/1964] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:40.721675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec85d-620d-41b9-b237-2cf0b9021dd9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:40.733183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bec85d-620d-41b9-b237-2cf0b9021dd9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:40.738674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016034c-59d2-4c44-a80c-984b6fd19b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:40.739592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016034c-59d2-4c44-a80c-984b6fd19b14 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:40.739875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016034c-59d2-4c44-a80c-984b6fd19b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:40.740150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8016034c-59d2-4c44-a80c-984b6fd19b14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:40.740906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016034c-59d2-4c44-a80c-984b6fd19b14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:40.742908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8016034c-59d2-4c44-a80c-984b6fd19b14 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:40.844908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '107da1af788341e4817a7038495f050c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.845565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '107da1af788341e4817a7038495f050c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.846260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '107da1af788341e4817a7038495f050c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:40.860602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 994/1965] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:40 2022] DELETE /identity/v3/users/107da1af788341e4817a7038495f050c => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:40.873207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=4,keystone:SELECT=91,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:40.888140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 972/1966] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:40 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:40.889274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:40.891868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:40.971683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14223cee-ee81-4d56-98df-74a910cd3f3d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:41.029961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480bcc-25cd-45ef-9b50-1e7a50ee8f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:41.031624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480bcc-25cd-45ef-9b50-1e7a50ee8f50 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.031949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480bcc-25cd-45ef-9b50-1e7a50ee8f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.032333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7480bcc-25cd-45ef-9b50-1e7a50ee8f50 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.033104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7480bcc-25cd-45ef-9b50-1e7a50ee8f50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:41.035334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7480bcc-25cd-45ef-9b50-1e7a50ee8f50 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:41.149503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 995/1967] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:40 2022] POST /identity/v3/users => generated 289 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:41.154229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016034c-59d2-4c44-a80c-984b6fd19b14 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:41.165431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8016034c-59d2-4c44-a80c-984b6fd19b14 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:41.174827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b00f2-4772-4ab3-947d-9a65d0900415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:41.175525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b00f2-4772-4ab3-947d-9a65d0900415 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.182913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b00f2-4772-4ab3-947d-9a65d0900415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.182913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b00f2-4772-4ab3-947d-9a65d0900415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.182913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b00f2-4772-4ab3-947d-9a65d0900415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:41.182913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b00f2-4772-4ab3-947d-9a65d0900415 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:41.190230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 973/1968] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:41.193795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480bcc-25cd-45ef-9b50-1e7a50ee8f50 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:41.204491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7480bcc-25cd-45ef-9b50-1e7a50ee8f50 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:41.209208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654430-d781-493b-a1f2-1f02725b6aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:41.209858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654430-d781-493b-a1f2-1f02725b6aef admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.210136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654430-d781-493b-a1f2-1f02725b6aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.210408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45654430-d781-493b-a1f2-1f02725b6aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.211124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45654430-d781-493b-a1f2-1f02725b6aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:41.212741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45654430-d781-493b-a1f2-1f02725b6aef admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:41.223372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 996/1969] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:41.227343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b00f2-4772-4ab3-947d-9a65d0900415 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:41.229038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654430-d781-493b-a1f2-1f02725b6aef admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:41.230965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-45654430-d781-493b-a1f2-1f02725b6aef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:41.239752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b00f2-4772-4ab3-947d-9a65d0900415 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:41.245629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f00217-7926-4b3f-bd8d-1e4446309065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:41.247259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f00217-7926-4b3f-bd8d-1e4446309065 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.247259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f00217-7926-4b3f-bd8d-1e4446309065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.247259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f00217-7926-4b3f-bd8d-1e4446309065 admin admin] PATH_INFO: `/v3/projects/5f6d68dc053f4a8fba7ea018169eb071/users/2212df5c2d5340b197a309a327cfa295/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.252723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45654430-d781-493b-a1f2-1f02725b6aef admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:41.259240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:41.260267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.260777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.261347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] PATH_INFO: `/v3/projects/95f0e451b0f44920831e8c653420686c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.263112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f0e451b0f44920831e8c653420686c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:41.263984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f00217-7926-4b3f-bd8d-1e4446309065 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f6d68dc053f4a8fba7ea018169eb071, user_id=2212df5c2d5340b197a309a327cfa295, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:41.267203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:41.269928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f00217-7926-4b3f-bd8d-1e4446309065 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:41.377384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 974/1970] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:41 2022] PUT /identity/v3/projects/5f6d68dc053f4a8fba7ea018169eb071/users/2212df5c2d5340b197a309a327cfa295/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:41.378238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f00217-7926-4b3f-bd8d-1e4446309065 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:41.379941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-92f00217-7926-4b3f-bd8d-1e4446309065 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:41.419064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f0e451b0f44920831e8c653420686c', 'request_id': 'req-894df5cb-9dd2-48e2-86c9-88887f3ccfca'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.427019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f0e451b0f44920831e8c653420686c', 'request_id': 'req-894df5cb-9dd2-48e2-86c9-88887f3ccfca'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.433151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f0e451b0f44920831e8c653420686c', 'request_id': 'req-894df5cb-9dd2-48e2-86c9-88887f3ccfca'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.455244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f00217-7926-4b3f-bd8d-1e4446309065 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:41.501530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] The token cache is being invalidate because project 95f0e451b0f44920831e8c653420686c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:41.501846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.502521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-894df5cb-9dd2-48e2-86c9-88887f3ccfca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.504095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 997/1971] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:41 2022] DELETE /identity/v3/projects/95f0e451b0f44920831e8c653420686c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:41.507244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b941303-7132-4c96-bea3-8a7eb8321ed8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.507244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b941303-7132-4c96-bea3-8a7eb8321ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.507244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b941303-7132-4c96-bea3-8a7eb8321ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.515861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:41.516738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.517024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.517299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] PATH_INFO: `/v3/projects/39578c81fb5b4b208039318217fdb3a2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.518533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39578c81fb5b4b208039318217fdb3a2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:41.520445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:41.538105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-7b941303-7132-4c96-bea3-8a7eb8321ed8 None None] MFA Rules not processed for user `2212df5c2d5340b197a309a327cfa295`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:41.540826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7b941303-7132-4c96-bea3-8a7eb8321ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:41.608043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 998/1972] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:41.609484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b941303-7132-4c96-bea3-8a7eb8321ed8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:41.611255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7b941303-7132-4c96-bea3-8a7eb8321ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:41.625925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b941303-7132-4c96-bea3-8a7eb8321ed8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:41.630935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:41.631813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.632123 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.632402 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] PATH_INFO: `/v3/users/bf513343bc07463ba9920fa2ef5d8b73` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.634114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf513343bc07463ba9920fa2ef5d8b73)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:41.635717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:41.651968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39578c81fb5b4b208039318217fdb3a2', 'request_id': 'req-49080ff9-d02b-45b6-b1eb-8665327c8c12'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.661067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39578c81fb5b4b208039318217fdb3a2', 'request_id': 'req-49080ff9-d02b-45b6-b1eb-8665327c8c12'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.667371 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39578c81fb5b4b208039318217fdb3a2', 'request_id': 'req-49080ff9-d02b-45b6-b1eb-8665327c8c12'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.701630 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:41.753471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] The token cache is being invalidate because project 39578c81fb5b4b208039318217fdb3a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:41.754140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.754505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.756144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 975/1973] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:41 2022] DELETE /identity/v3/projects/39578c81fb5b4b208039318217fdb3a2 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:41.756940 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:41.758304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:41.817046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49080ff9-d02b-45b6-b1eb-8665327c8c12 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:41.820945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c4b2ad-7442-4549-bc0c-b87b2d38c23d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:41.821620 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b2ad-7442-4549-bc0c-b87b2d38c23d service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.821903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b2ad-7442-4549-bc0c-b87b2d38c23d service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.822192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c4b2ad-7442-4549-bc0c-b87b2d38c23d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.824070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-91c4b2ad-7442-4549-bc0c-b87b2d38c23d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:41.853174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf513343bc07463ba9920fa2ef5d8b73'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.865983 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf513343bc07463ba9920fa2ef5d8b73'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.896084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4b2ad-7442-4549-bc0c-b87b2d38c23d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:41.897638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c4b2ad-7442-4549-bc0c-b87b2d38c23d service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:41.908608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 976/1974] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:41.909949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceab926-6bfd-4c4e-a9e1-fa0b7c56ded0 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:41.914497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceab926-6bfd-4c4e-a9e1-fa0b7c56ded0 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:41.914497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceab926-6bfd-4c4e-a9e1-fa0b7c56ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:41.929906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7ceab926-6bfd-4c4e-a9e1-fa0b7c56ded0 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:41.931093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7ceab926-6bfd-4c4e-a9e1-fa0b7c56ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:41.935516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf513343bc07463ba9920fa2ef5d8b73'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.939868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf513343bc07463ba9920fa2ef5d8b73'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.939868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c1bfaac-7433-4e20-98d3-ebc84e6cc3b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf513343bc07463ba9920fa2ef5d8b73'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:41.952304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 999/1975] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:41 2022] DELETE /identity/v3/users/bf513343bc07463ba9920fa2ef5d8b73 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:42.004078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 977/1976] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:42.013141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e850ce8-18d9-4ec7-b0e2-cd764c60617d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.014074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e850ce8-18d9-4ec7-b0e2-cd764c60617d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.014768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e850ce8-18d9-4ec7-b0e2-cd764c60617d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.045407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4e850ce8-18d9-4ec7-b0e2-cd764c60617d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:42.047381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4e850ce8-18d9-4ec7-b0e2-cd764c60617d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:42.119079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1000/1977] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:42.123278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceab926-6bfd-4c4e-a9e1-fa0b7c56ded0 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:42.134094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceab926-6bfd-4c4e-a9e1-fa0b7c56ded0 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:42.138923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29728-72ac-4f8b-a074-b5fd1de4c090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:42.139655 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29728-72ac-4f8b-a074-b5fd1de4c090 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.140351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29728-72ac-4f8b-a074-b5fd1de4c090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.140673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c29728-72ac-4f8b-a074-b5fd1de4c090 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.148569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c29728-72ac-4f8b-a074-b5fd1de4c090 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:42.148569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c29728-72ac-4f8b-a074-b5fd1de4c090 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:42.148569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c29728-72ac-4f8b-a074-b5fd1de4c090 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:42.157183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 978/1978] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:42.161955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e850ce8-18d9-4ec7-b0e2-cd764c60617d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:42.171782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e850ce8-18d9-4ec7-b0e2-cd764c60617d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:42.176776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710450f-73a0-434e-bcec-cd70ff1f1919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:42.177388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710450f-73a0-434e-bcec-cd70ff1f1919 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.177673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710450f-73a0-434e-bcec-cd70ff1f1919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.177948 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f710450f-73a0-434e-bcec-cd70ff1f1919 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.178637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710450f-73a0-434e-bcec-cd70ff1f1919 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:42.180576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f710450f-73a0-434e-bcec-cd70ff1f1919 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:42.300000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1001/1979] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:42 2022] POST /identity/v3/projects => generated 375 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:42.304169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29728-72ac-4f8b-a074-b5fd1de4c090 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:42.314054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c29728-72ac-4f8b-a074-b5fd1de4c090 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:42.376278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9db37a-fa0a-4deb-94d7-bbfb52e2627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:42.377069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9db37a-fa0a-4deb-94d7-bbfb52e2627f admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.377413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9db37a-fa0a-4deb-94d7-bbfb52e2627f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.377753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9db37a-fa0a-4deb-94d7-bbfb52e2627f admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.378525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9db37a-fa0a-4deb-94d7-bbfb52e2627f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:42.380611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9db37a-fa0a-4deb-94d7-bbfb52e2627f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:42.509090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710450f-73a0-434e-bcec-cd70ff1f1919 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:42.510780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f710450f-73a0-434e-bcec-cd70ff1f1919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:42.512915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 979/1980] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:42 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:42.517207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9db37a-fa0a-4deb-94d7-bbfb52e2627f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:42.527826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9db37a-fa0a-4deb-94d7-bbfb52e2627f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:42.534082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da7a18-f1b2-450f-83ad-e8a6ff4563a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:42.534812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da7a18-f1b2-450f-83ad-e8a6ff4563a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.535146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da7a18-f1b2-450f-83ad-e8a6ff4563a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.535357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16da7a18-f1b2-450f-83ad-e8a6ff4563a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.536152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da7a18-f1b2-450f-83ad-e8a6ff4563a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:42.537998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16da7a18-f1b2-450f-83ad-e8a6ff4563a4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:42.540120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f710450f-73a0-434e-bcec-cd70ff1f1919 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:42.547055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:42.548004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.548291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.548622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] PATH_INFO: `/v3/projects/987d2ca035c4417ab965706c899fb951` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.549217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 980/1981] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:42.549830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=987d2ca035c4417ab965706c899fb951)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:42.554565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:42.554724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da7a18-f1b2-450f-83ad-e8a6ff4563a4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:42.566667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16da7a18-f1b2-450f-83ad-e8a6ff4563a4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:42.571577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33dc7d-8a38-48ef-b447-87335efc4c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:42.572246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33dc7d-8a38-48ef-b447-87335efc4c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.572581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33dc7d-8a38-48ef-b447-87335efc4c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.578140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33dc7d-8a38-48ef-b447-87335efc4c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.578140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33dc7d-8a38-48ef-b447-87335efc4c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:42.578140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b33dc7d-8a38-48ef-b447-87335efc4c23 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:42.588551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 981/1982] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:37:42.591327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33dc7d-8a38-48ef-b447-87335efc4c23 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:42.602107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33dc7d-8a38-48ef-b447-87335efc4c23 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:42.607138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51f5b0-85f7-4614-a0c0-274686eacb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:42.608037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51f5b0-85f7-4614-a0c0-274686eacb3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.608353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51f5b0-85f7-4614-a0c0-274686eacb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.608646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51f5b0-85f7-4614-a0c0-274686eacb3c admin admin] PATH_INFO: `/v3/projects/ad9af32f663341cfb578c94b572aec04/users/1238adafe48a433a8710c678c45b2e90/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.623634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51f5b0-85f7-4614-a0c0-274686eacb3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9af32f663341cfb578c94b572aec04, user_id=1238adafe48a433a8710c678c45b2e90, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:42.627215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a51f5b0-85f7-4614-a0c0-274686eacb3c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:42.703528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:42.712810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 982/1983] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:42 2022] PUT /identity/v3/projects/ad9af32f663341cfb578c94b572aec04/users/1238adafe48a433a8710c678c45b2e90/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:42.720223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987d2ca035c4417ab965706c899fb951', 'request_id': 'req-f35430c9-bde5-4481-9025-e2952538da36'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:42.723611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d30cc-77c6-4ba1-88a3-f1669fbd344b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.723956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d30cc-77c6-4ba1-88a3-f1669fbd344b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.724238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881d30cc-77c6-4ba1-88a3-f1669fbd344b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.727724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987d2ca035c4417ab965706c899fb951', 'request_id': 'req-f35430c9-bde5-4481-9025-e2952538da36'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:42.734517 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987d2ca035c4417ab965706c899fb951', 'request_id': 'req-f35430c9-bde5-4481-9025-e2952538da36'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:42.761557 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-881d30cc-77c6-4ba1-88a3-f1669fbd344b None None] MFA Rules not processed for user `1238adafe48a433a8710c678c45b2e90`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:42.762878 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-881d30cc-77c6-4ba1-88a3-f1669fbd344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:42.833265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] The token cache is being invalidate because project 987d2ca035c4417ab965706c899fb951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:42.833607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:42.834239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f35430c9-bde5-4481-9025-e2952538da36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:42.836241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1002/1984] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:42 2022] DELETE /identity/v3/projects/987d2ca035c4417ab965706c899fb951 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:42.840936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b5035-e786-42c9-923a-c499ca544b0d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.841220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b5035-e786-42c9-923a-c499ca544b0d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.841527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b5035-e786-42c9-923a-c499ca544b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.843805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 983/1985] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:42.857228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d30cc-77c6-4ba1-88a3-f1669fbd344b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:42.858587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-881d30cc-77c6-4ba1-88a3-f1669fbd344b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:42.860017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ff6b5035-e786-42c9-923a-c499ca544b0d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:42.861071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ff6b5035-e786-42c9-923a-c499ca544b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:42.863696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:42.931758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1003/1986] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:42.940158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187c97b-5c4b-41fe-9723-b8807a32b6ea None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.940535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187c97b-5c4b-41fe-9723-b8807a32b6ea None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.940825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4187c97b-5c4b-41fe-9723-b8807a32b6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.944909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881d30cc-77c6-4ba1-88a3-f1669fbd344b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:42.951234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f0ad6-fa26-495e-9fbd-a0276de47dd6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:42.951897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f0ad6-fa26-495e-9fbd-a0276de47dd6 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.952179 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f0ad6-fa26-495e-9fbd-a0276de47dd6 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.953526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f0ad6-fa26-495e-9fbd-a0276de47dd6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.955460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-da1f0ad6-fa26-495e-9fbd-a0276de47dd6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:42.961565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4187c97b-5c4b-41fe-9723-b8807a32b6ea None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:42.962761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4187c97b-5c4b-41fe-9723-b8807a32b6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:42.967099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f0ad6-fa26-495e-9fbd-a0276de47dd6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:42.969584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1f0ad6-fa26-495e-9fbd-a0276de47dd6 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:42.971760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1004/1987] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:42.976056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187c97b-5c4b-41fe-9723-b8807a32b6ea None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:42.980987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 984/1988] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:42.986157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4187c97b-5c4b-41fe-9723-b8807a32b6ea None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:42.991082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c98da4-6a22-4393-8d1a-55fc19cb9e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:42.991783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98da4-6a22-4393-8d1a-55fc19cb9e07 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:42.992069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98da4-6a22-4393-8d1a-55fc19cb9e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:42.992345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c98da4-6a22-4393-8d1a-55fc19cb9e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:42.993138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c98da4-6a22-4393-8d1a-55fc19cb9e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:42.993446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c98da4-6a22-4393-8d1a-55fc19cb9e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:42.995137 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c98da4-6a22-4393-8d1a-55fc19cb9e07 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:43.007784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1005/1989] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:37:43.015425 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f0ad6-fa26-495e-9fbd-a0276de47dd6 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:43.026947 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1f0ad6-fa26-495e-9fbd-a0276de47dd6 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:43.038623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3684-8820-42e6-a589-382bee294e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:43.038623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3684-8820-42e6-a589-382bee294e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.038623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3684-8820-42e6-a589-382bee294e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.038623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac3684-8820-42e6-a589-382bee294e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.039297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac3684-8820-42e6-a589-382bee294e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:43.039297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac3684-8820-42e6-a589-382bee294e5f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:43.167043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 985/1990] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:43 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:43.167146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c98da4-6a22-4393-8d1a-55fc19cb9e07 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:43.178641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c98da4-6a22-4393-8d1a-55fc19cb9e07 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:43.217508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3684-8820-42e6-a589-382bee294e5f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:43.219497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9cac3684-8820-42e6-a589-382bee294e5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:43.259801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90637bbf-5d55-43f5-9489-09192199e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:43.260433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90637bbf-5d55-43f5-9489-09192199e94a admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.260850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90637bbf-5d55-43f5-9489-09192199e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.261205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90637bbf-5d55-43f5-9489-09192199e94a admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.261977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90637bbf-5d55-43f5-9489-09192199e94a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:43.264023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90637bbf-5d55-43f5-9489-09192199e94a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:43.297301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac3684-8820-42e6-a589-382bee294e5f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:43.302240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:43.303132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.303441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.303715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] PATH_INFO: `/v3/users/1238adafe48a433a8710c678c45b2e90` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.304959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1238adafe48a433a8710c678c45b2e90)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:43.306902 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:43.341989 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1006/1991] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:43 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:43.346116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90637bbf-5d55-43f5-9489-09192199e94a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:43.347613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:43.357172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90637bbf-5d55-43f5-9489-09192199e94a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:43.362477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c23f3-929d-44b3-a0c9-e2dc8469cc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:43.363136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c23f3-929d-44b3-a0c9-e2dc8469cc4a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.363420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c23f3-929d-44b3-a0c9-e2dc8469cc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.363698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c23f3-929d-44b3-a0c9-e2dc8469cc4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.364424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c23f3-929d-44b3-a0c9-e2dc8469cc4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:43.366058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c23f3-929d-44b3-a0c9-e2dc8469cc4a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:43.377485 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1007/1992] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:37:43.385220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c23f3-929d-44b3-a0c9-e2dc8469cc4a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:43.395869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c23f3-929d-44b3-a0c9-e2dc8469cc4a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:43.400998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad5178-7efb-43ce-821d-d1be2a628c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:43.401643 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad5178-7efb-43ce-821d-d1be2a628c74 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.401924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad5178-7efb-43ce-821d-d1be2a628c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.402197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad5178-7efb-43ce-821d-d1be2a628c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.402957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad5178-7efb-43ce-821d-d1be2a628c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:43.404564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad5178-7efb-43ce-821d-d1be2a628c74 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:43.415220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1008/1993] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:37:43.419336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad5178-7efb-43ce-821d-d1be2a628c74 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:43.429779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad5178-7efb-43ce-821d-d1be2a628c74 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:43.435155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a36bf-c3b5-4d9a-85b6-b7d21820172d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:43.436042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a36bf-c3b5-4d9a-85b6-b7d21820172d admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.436395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a36bf-c3b5-4d9a-85b6-b7d21820172d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.436900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a36bf-c3b5-4d9a-85b6-b7d21820172d admin admin] PATH_INFO: `/v3/projects/be56beb81c88493794dc0c8f0ea3b81b/users/5f0c551208b74836b7778c24eb3cacee/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.444563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1238adafe48a433a8710c678c45b2e90'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:43.453044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a36bf-c3b5-4d9a-85b6-b7d21820172d admin admin] RBAC: Authorizing `identity:create_grant(project_id=be56beb81c88493794dc0c8f0ea3b81b, user_id=5f0c551208b74836b7778c24eb3cacee, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:43.453498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1238adafe48a433a8710c678c45b2e90'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:43.454324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1238adafe48a433a8710c678c45b2e90'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:43.455848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a36bf-c3b5-4d9a-85b6-b7d21820172d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:43.472958 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1238adafe48a433a8710c678c45b2e90'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:43.473203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:43.473722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-173afd53-c0f5-43c5-a364-4f95f4e70d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1238adafe48a433a8710c678c45b2e90'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:43.548066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1009/1994] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:43 2022] PUT /identity/v3/projects/be56beb81c88493794dc0c8f0ea3b81b/users/5f0c551208b74836b7778c24eb3cacee/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:43.548598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 986/1995] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:43 2022] DELETE /identity/v3/users/1238adafe48a433a8710c678c45b2e90 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:43.559472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a4bc2-3ef8-4277-8f63-555dd81f9c35 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.559753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a4bc2-3ef8-4277-8f63-555dd81f9c35 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.560025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a4bc2-3ef8-4277-8f63-555dd81f9c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.567018 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ed450-eff5-4749-8820-42ee465b4599 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.567440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ed450-eff5-4749-8820-42ee465b4599 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.567725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214ed450-eff5-4749-8820-42ee465b4599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.578602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-eb2a4bc2-3ef8-4277-8f63-555dd81f9c35 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:43.579840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-eb2a4bc2-3ef8-4277-8f63-555dd81f9c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:43.596542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-214ed450-eff5-4749-8820-42ee465b4599 None None] MFA Rules not processed for user `5f0c551208b74836b7778c24eb3cacee`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:43.596947 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-214ed450-eff5-4749-8820-42ee465b4599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:43.652340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1010/1996] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:43.662645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a4bc2-3ef8-4277-8f63-555dd81f9c35 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:43.664012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-eb2a4bc2-3ef8-4277-8f63-555dd81f9c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:43.670166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 987/1997] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:43.674584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ed450-eff5-4749-8820-42ee465b4599 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:43.675981 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-214ed450-eff5-4749-8820-42ee465b4599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:43.691591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214ed450-eff5-4749-8820-42ee465b4599 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:43.696150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7010ad-1ef3-4568-b82c-3bc697f449e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:43.696833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7010ad-1ef3-4568-b82c-3bc697f449e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.697114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7010ad-1ef3-4568-b82c-3bc697f449e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.697387 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7010ad-1ef3-4568-b82c-3bc697f449e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.698077 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7010ad-1ef3-4568-b82c-3bc697f449e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:43.699988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7010ad-1ef3-4568-b82c-3bc697f449e3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:43.725375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a4bc2-3ef8-4277-8f63-555dd81f9c35 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:43.729481 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a3629-b4a3-4b94-b3e8-f0a946ca3f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:43.730498 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a3629-b4a3-4b94-b3e8-f0a946ca3f0f service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.730793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a3629-b4a3-4b94-b3e8-f0a946ca3f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.731282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801a3629-b4a3-4b94-b3e8-f0a946ca3f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.743679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a3629-b4a3-4b94-b3e8-f0a946ca3f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:43.745186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801a3629-b4a3-4b94-b3e8-f0a946ca3f0f service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:43.755618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1011/1998] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:43.799280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 988/1999] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:43 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:43.803984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a3629-b4a3-4b94-b3e8-f0a946ca3f0f service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:43.815524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801a3629-b4a3-4b94-b3e8-f0a946ca3f0f service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:43.867102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:43.874133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e96190-5f8d-40ce-80ba-1c51a89ffd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:43.875154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e96190-5f8d-40ce-80ba-1c51a89ffd43 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:43.875433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e96190-5f8d-40ce-80ba-1c51a89ffd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:43.875708 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e96190-5f8d-40ce-80ba-1c51a89ffd43 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:43.876392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e96190-5f8d-40ce-80ba-1c51a89ffd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:43.878706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e96190-5f8d-40ce-80ba-1c51a89ffd43 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:44.043128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1012/2000] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:43 2022] POST /identity/v3/users => generated 299 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:44.044372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7010ad-1ef3-4568-b82c-3bc697f449e3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:44.056255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7010ad-1ef3-4568-b82c-3bc697f449e3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:44.061161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fc76a-dc41-4735-9768-f147ee395e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:44.061970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc76a-dc41-4735-9768-f147ee395e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.062316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc76a-dc41-4735-9768-f147ee395e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.062664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc76a-dc41-4735-9768-f147ee395e13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.063519 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fc76a-dc41-4735-9768-f147ee395e13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:44.065385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fc76a-dc41-4735-9768-f147ee395e13 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:44.078184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 989/2001] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:44.082390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e96190-5f8d-40ce-80ba-1c51a89ffd43 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:44.092523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e96190-5f8d-40ce-80ba-1c51a89ffd43 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:44.097875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb411a-dbd1-493b-a4c7-e73f33b3c72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:44.098832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb411a-dbd1-493b-a4c7-e73f33b3c72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.099107 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb411a-dbd1-493b-a4c7-e73f33b3c72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.099376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfb411a-dbd1-493b-a4c7-e73f33b3c72e admin admin] PATH_INFO: `/v3/projects/198ae951926f4440b14132e94ae656de/users/9acd77b781c74132a91172dbd7be59ca/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.114774 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb411a-dbd1-493b-a4c7-e73f33b3c72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=198ae951926f4440b14132e94ae656de, user_id=9acd77b781c74132a91172dbd7be59ca, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:44.117591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfb411a-dbd1-493b-a4c7-e73f33b3c72e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:44.275256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fc76a-dc41-4735-9768-f147ee395e13 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:44.277403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-309fc76a-dc41-4735-9768-f147ee395e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:44.283295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1013/2002] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:44 2022] PUT /identity/v3/projects/198ae951926f4440b14132e94ae656de/users/9acd77b781c74132a91172dbd7be59ca/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:44.286913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb411a-dbd1-493b-a4c7-e73f33b3c72e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:44.306660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fc76a-dc41-4735-9768-f147ee395e13 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:44.355826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfb411a-dbd1-493b-a4c7-e73f33b3c72e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:44.360935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f59c8-172f-4073-bf2d-86f26c43b32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:44.361600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f59c8-172f-4073-bf2d-86f26c43b32e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.361890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f59c8-172f-4073-bf2d-86f26c43b32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.362165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f59c8-172f-4073-bf2d-86f26c43b32e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.363040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f59c8-172f-4073-bf2d-86f26c43b32e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:44.364843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5f59c8-172f-4073-bf2d-86f26c43b32e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:44.372455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:44.373439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.374206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.374206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] PATH_INFO: `/v3/projects/ad9af32f663341cfb578c94b572aec04` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.379705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9af32f663341cfb578c94b572aec04)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:44.379871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1014/2003] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:37:44.379957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:44.380650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f59c8-172f-4073-bf2d-86f26c43b32e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:44.392785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5f59c8-172f-4073-bf2d-86f26c43b32e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:44.397783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132f1e6-9ef2-4e9f-bd81-83e15effab98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:44.399396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132f1e6-9ef2-4e9f-bd81-83e15effab98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.399772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132f1e6-9ef2-4e9f-bd81-83e15effab98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.400149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132f1e6-9ef2-4e9f-bd81-83e15effab98 admin admin] PATH_INFO: `/v3/projects/198ae951926f4440b14132e94ae656de/users/9acd77b781c74132a91172dbd7be59ca/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.402468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132f1e6-9ef2-4e9f-bd81-83e15effab98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=198ae951926f4440b14132e94ae656de, user_id=9acd77b781c74132a91172dbd7be59ca, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:44.405438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132f1e6-9ef2-4e9f-bd81-83e15effab98 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:44.425029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1015/2004] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:44 2022] PUT /identity/v3/projects/198ae951926f4440b14132e94ae656de/users/9acd77b781c74132a91172dbd7be59ca/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:44.432042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed287-984c-4fe8-a7e4-0a12c0b94116 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.432337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed287-984c-4fe8-a7e4-0a12c0b94116 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.432652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ed287-984c-4fe8-a7e4-0a12c0b94116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.467609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-be4ed287-984c-4fe8-a7e4-0a12c0b94116 None None] MFA Rules not processed for user `9acd77b781c74132a91172dbd7be59ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:44.469222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-be4ed287-984c-4fe8-a7e4-0a12c0b94116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:44.537583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1016/2005] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:44.549134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed287-984c-4fe8-a7e4-0a12c0b94116 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:44.550528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-be4ed287-984c-4fe8-a7e4-0a12c0b94116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:44.579481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9af32f663341cfb578c94b572aec04', 'request_id': 'req-1040e230-11ae-4764-a916-f71b9ebbc672'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:44.587220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9af32f663341cfb578c94b572aec04', 'request_id': 'req-1040e230-11ae-4764-a916-f71b9ebbc672'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:44.594274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9af32f663341cfb578c94b572aec04', 'request_id': 'req-1040e230-11ae-4764-a916-f71b9ebbc672'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:44.615319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ed287-984c-4fe8-a7e4-0a12c0b94116 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:44.662788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff618a9-ef93-4242-ba93-17c24339be6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:44.663434 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff618a9-ef93-4242-ba93-17c24339be6d service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.663721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff618a9-ef93-4242-ba93-17c24339be6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.663993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff618a9-ef93-4242-ba93-17c24339be6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.718967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff618a9-ef93-4242-ba93-17c24339be6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:44.720609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff618a9-ef93-4242-ba93-17c24339be6d service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:44.730137 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1017/2006] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:37:44.738925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] The token cache is being invalidate because project ad9af32f663341cfb578c94b572aec04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:44.739218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:44.739867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1040e230-11ae-4764-a916-f71b9ebbc672 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:44.743245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 990/2007] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:44 2022] DELETE /identity/v3/projects/ad9af32f663341cfb578c94b572aec04 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:44.746281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaa418-2396-4b50-b262-eff68d488bf1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.746572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaa418-2396-4b50-b262-eff68d488bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.746851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eaa418-2396-4b50-b262-eff68d488bf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.767831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e3eaa418-2396-4b50-b262-eff68d488bf1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:44.769175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e3eaa418-2396-4b50-b262-eff68d488bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:44.830219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1018/2008] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:44.838548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0bd8e-6f98-46d9-90b6-967863c9ef24 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.839030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0bd8e-6f98-46d9-90b6-967863c9ef24 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.839121 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0bd8e-6f98-46d9-90b6-967863c9ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.850582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:44.858039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3fd0bd8e-6f98-46d9-90b6-967863c9ef24 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:44.859793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3fd0bd8e-6f98-46d9-90b6-967863c9ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:44.867855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 991/2009] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:44.872074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaa418-2396-4b50-b262-eff68d488bf1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:44.883372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eaa418-2396-4b50-b262-eff68d488bf1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:44.888411 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c35d3-4cbb-4d07-9484-d7284ae25f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:44.889027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c35d3-4cbb-4d07-9484-d7284ae25f8b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.889360 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c35d3-4cbb-4d07-9484-d7284ae25f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.889611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c35d3-4cbb-4d07-9484-d7284ae25f8b admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.890775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c35d3-4cbb-4d07-9484-d7284ae25f8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:44.891136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c35d3-4cbb-4d07-9484-d7284ae25f8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:44.892943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c35d3-4cbb-4d07-9484-d7284ae25f8b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:44.906033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1019/2010] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:37:44.909131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0bd8e-6f98-46d9-90b6-967863c9ef24 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:44.918739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0bd8e-6f98-46d9-90b6-967863c9ef24 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:44.922390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:44.927301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0155c7-0f87-4439-90c0-09331e5626b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:44.927969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0155c7-0f87-4439-90c0-09331e5626b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:44.928256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0155c7-0f87-4439-90c0-09331e5626b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:44.928624 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0155c7-0f87-4439-90c0-09331e5626b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:44.929318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0155c7-0f87-4439-90c0-09331e5626b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:44.931225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0155c7-0f87-4439-90c0-09331e5626b4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:45.032764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 992/2011] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:44 2022] POST /identity/v3/projects => generated 405 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:45.044126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c35d3-4cbb-4d07-9484-d7284ae25f8b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:45.054752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c35d3-4cbb-4d07-9484-d7284ae25f8b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:45.109542 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6ac70-82be-470a-b8ed-bf2c6c56e391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:45.110214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6ac70-82be-470a-b8ed-bf2c6c56e391 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:45.110480 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6ac70-82be-470a-b8ed-bf2c6c56e391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:45.110747 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6ac70-82be-470a-b8ed-bf2c6c56e391 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:45.111474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6ac70-82be-470a-b8ed-bf2c6c56e391 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:45.113414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6ac70-82be-470a-b8ed-bf2c6c56e391 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:45.204831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:45.250037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1020/2012] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:45 2022] POST /identity/v3/users => generated 303 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:45.254099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0155c7-0f87-4439-90c0-09331e5626b4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:45.264374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0155c7-0f87-4439-90c0-09331e5626b4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:45.270536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e692f-42de-400e-96a2-c48677216bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:45.271224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e692f-42de-400e-96a2-c48677216bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:45.271536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e692f-42de-400e-96a2-c48677216bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:45.271819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e692f-42de-400e-96a2-c48677216bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:45.272586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e692f-42de-400e-96a2-c48677216bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:45.274189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e692f-42de-400e-96a2-c48677216bbb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:45.285945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 993/2013] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:45.289976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6ac70-82be-470a-b8ed-bf2c6c56e391 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:45.300488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6ac70-82be-470a-b8ed-bf2c6c56e391 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:45.305036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b99a89-3069-420f-815a-034c10307322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:45.305689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b99a89-3069-420f-815a-034c10307322 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:45.305970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b99a89-3069-420f-815a-034c10307322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:45.306247 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b99a89-3069-420f-815a-034c10307322 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:45.306964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b99a89-3069-420f-815a-034c10307322 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:45.308598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b99a89-3069-420f-815a-034c10307322 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:45.318446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1021/2014] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:45.327001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e692f-42de-400e-96a2-c48677216bbb admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:45.336992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e692f-42de-400e-96a2-c48677216bbb admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:45.341455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a950-5ef2-4092-85b3-cb23212942b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:45.342363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a950-5ef2-4092-85b3-cb23212942b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:45.342644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a950-5ef2-4092-85b3-cb23212942b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:45.342936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8825a950-5ef2-4092-85b3-cb23212942b7 admin admin] PATH_INFO: `/v3/projects/53cd148d7b60483184fba7acb933f24a/users/8e9709190a1348de9a8886b68867a893/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:45.358426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825a950-5ef2-4092-85b3-cb23212942b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53cd148d7b60483184fba7acb933f24a, user_id=8e9709190a1348de9a8886b68867a893, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:45.361713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8825a950-5ef2-4092-85b3-cb23212942b7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:45.478644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 994/2015] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:45 2022] PUT /identity/v3/projects/53cd148d7b60483184fba7acb933f24a/users/8e9709190a1348de9a8886b68867a893/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:45.489971 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf9cf-b17a-4661-b165-0630703304ed None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:45.490261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf9cf-b17a-4661-b165-0630703304ed None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:45.490541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1bf9cf-b17a-4661-b165-0630703304ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:45.519477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8a1bf9cf-b17a-4661-b165-0630703304ed None None] MFA Rules not processed for user `8e9709190a1348de9a8886b68867a893`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:45.520787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8a1bf9cf-b17a-4661-b165-0630703304ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:45.589713 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1022/2016] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:45.594486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a950-5ef2-4092-85b3-cb23212942b7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:45.679242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8825a950-5ef2-4092-85b3-cb23212942b7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:45.684226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d724-df84-47b8-997c-835124f82cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:45.684951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d724-df84-47b8-997c-835124f82cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:45.685417 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d724-df84-47b8-997c-835124f82cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:45.685544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217d724-df84-47b8-997c-835124f82cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:45.689443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217d724-df84-47b8-997c-835124f82cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:45.689443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217d724-df84-47b8-997c-835124f82cfb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:45.787660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 995/2017] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:45 2022] POST /identity/v3/projects => generated 405 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:45.791857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf9cf-b17a-4661-b165-0630703304ed None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:45.803819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1bf9cf-b17a-4661-b165-0630703304ed None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:45.862810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ff599-c247-4bed-9f91-7be7c5ac5d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:45.863487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ff599-c247-4bed-9f91-7be7c5ac5d2b admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:45.863769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ff599-c247-4bed-9f91-7be7c5ac5d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:45.864043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ff599-c247-4bed-9f91-7be7c5ac5d2b admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:45.864795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ff599-c247-4bed-9f91-7be7c5ac5d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:45.866760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ff599-c247-4bed-9f91-7be7c5ac5d2b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:45.988373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1023/2018] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:45 2022] POST /identity/v3/users => generated 309 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:45.992634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d724-df84-47b8-997c-835124f82cfb admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:46.003342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217d724-df84-47b8-997c-835124f82cfb admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:46.007982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d8e7-c957-4f5b-a71c-4e85b3374fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:46.008685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d8e7-c957-4f5b-a71c-4e85b3374fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:46.008972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d8e7-c957-4f5b-a71c-4e85b3374fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:46.009256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d8e7-c957-4f5b-a71c-4e85b3374fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:46.009989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727d8e7-c957-4f5b-a71c-4e85b3374fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:46.011588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727d8e7-c957-4f5b-a71c-4e85b3374fa8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:46.022348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 996/2019] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:46.026483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ff599-c247-4bed-9f91-7be7c5ac5d2b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:46.037200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ff599-c247-4bed-9f91-7be7c5ac5d2b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:46.041802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb2455-1867-46d9-8fb6-e6af70fa5368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:46.047102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb2455-1867-46d9-8fb6-e6af70fa5368 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:46.047102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb2455-1867-46d9-8fb6-e6af70fa5368 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:46.047102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb2455-1867-46d9-8fb6-e6af70fa5368 admin admin] PATH_INFO: `/v3/projects/768fad8c02d44ed98e645080a5e11ae6/users/a3365930d9654b628d14d4c302407831/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:46.058413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb2455-1867-46d9-8fb6-e6af70fa5368 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768fad8c02d44ed98e645080a5e11ae6, user_id=a3365930d9654b628d14d4c302407831, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:46.061098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb2455-1867-46d9-8fb6-e6af70fa5368 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:46.158527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1024/2020] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:46 2022] PUT /identity/v3/projects/768fad8c02d44ed98e645080a5e11ae6/users/a3365930d9654b628d14d4c302407831/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:46.162597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d8e7-c957-4f5b-a71c-4e85b3374fa8 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:46.169039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:46.174779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d8e7-c957-4f5b-a71c-4e85b3374fa8 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:46.231233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bebb1-277c-4a60-94f6-18fce68b582c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:46.231925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bebb1-277c-4a60-94f6-18fce68b582c admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:46.232211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bebb1-277c-4a60-94f6-18fce68b582c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:46.232583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bebb1-277c-4a60-94f6-18fce68b582c admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:46.233316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bebb1-277c-4a60-94f6-18fce68b582c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:46.234993 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bebb1-277c-4a60-94f6-18fce68b582c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:46.244656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 997/2021] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:46.248812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb2455-1867-46d9-8fb6-e6af70fa5368 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:46.258905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb2455-1867-46d9-8fb6-e6af70fa5368 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:46.263496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b691037-0cac-4162-a8c0-ab092601e2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:46.264363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b691037-0cac-4162-a8c0-ab092601e2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:46.264673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b691037-0cac-4162-a8c0-ab092601e2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:46.265482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b691037-0cac-4162-a8c0-ab092601e2d9 admin admin] PATH_INFO: `/v3/projects/768fad8c02d44ed98e645080a5e11ae6/users/a3365930d9654b628d14d4c302407831/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:46.267603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b691037-0cac-4162-a8c0-ab092601e2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=768fad8c02d44ed98e645080a5e11ae6, user_id=a3365930d9654b628d14d4c302407831, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:46.270368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b691037-0cac-4162-a8c0-ab092601e2d9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:46.281463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1025/2022] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:46 2022] PUT /identity/v3/projects/768fad8c02d44ed98e645080a5e11ae6/users/a3365930d9654b628d14d4c302407831/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:46.292780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ca5cf-f8ee-49ac-ab07-0e2fffe30a06 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:46.293071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ca5cf-f8ee-49ac-ab07-0e2fffe30a06 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:46.293352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ca5cf-f8ee-49ac-ab07-0e2fffe30a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:46.307859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:46.319622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-538ca5cf-f8ee-49ac-ab07-0e2fffe30a06 None None] MFA Rules not processed for user `a3365930d9654b628d14d4c302407831`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:46.320875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-538ca5cf-f8ee-49ac-ab07-0e2fffe30a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:46.387684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 998/2023] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:46 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:46.398859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b691037-0cac-4162-a8c0-ab092601e2d9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:46.400568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4b691037-0cac-4162-a8c0-ab092601e2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:46.457778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b691037-0cac-4162-a8c0-ab092601e2d9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:46.462245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4beb8f8-a860-4067-b2a3-31965cbe825a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:46.462886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb8f8-a860-4067-b2a3-31965cbe825a service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:46.463164 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb8f8-a860-4067-b2a3-31965cbe825a service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:46.463436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4beb8f8-a860-4067-b2a3-31965cbe825a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:46.473121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beb8f8-a860-4067-b2a3-31965cbe825a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:46.474625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4beb8f8-a860-4067-b2a3-31965cbe825a service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:46.484286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1026/2024] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:46 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:46.662012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:46.713402 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:46.975791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=3,keystone:INSERT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.090090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.233042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.278911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.301440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.398687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.490028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.524569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.594001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.678840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.764658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:INSERT=3,keystone:DELETE=5,keystone:SELECT=92 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.792914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.935544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.964281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:47.971857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ca5cf-f8ee-49ac-ab07-0e2fffe30a06 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:48.034689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ca5cf-f8ee-49ac-ab07-0e2fffe30a06 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:48.039128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:48.039996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:48.040279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:48.040583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] PATH_INFO: `/v3/users/8e9709190a1348de9a8886b68867a893` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:48.041767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9709190a1348de9a8886b68867a893)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:48.043750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:48.263870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:48.277773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9709190a1348de9a8886b68867a893'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:48.284672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9709190a1348de9a8886b68867a893'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:48.285393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9709190a1348de9a8886b68867a893'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:48.296934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9709190a1348de9a8886b68867a893'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:48.297574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9709190a1348de9a8886b68867a893'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:48.330624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:48.359201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 999/2025] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:47 2022] DELETE /identity/v3/users/8e9709190a1348de9a8886b68867a893 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:48.364252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9a70c-3163-47f2-ae38-17f84ad40600 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:48.364638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9a70c-3163-47f2-ae38-17f84ad40600 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:48.364987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9a70c-3163-47f2-ae38-17f84ad40600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:48.383538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d5d9a70c-3163-47f2-ae38-17f84ad40600 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:48.388278 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d5d9a70c-3163-47f2-ae38-17f84ad40600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:48.441937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1027/2026] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:37:48.451380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:48.453086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:48.510355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d10d9-c65c-4bbb-8192-555c0bc297ef admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:48.513634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:48.516052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7780e-b883-497d-a232-b169a2404442 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:48.516785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7780e-b883-497d-a232-b169a2404442 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:48.517074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7780e-b883-497d-a232-b169a2404442 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:48.517354 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef7780e-b883-497d-a232-b169a2404442 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:48.527130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7780e-b883-497d-a232-b169a2404442 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:48.528752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef7780e-b883-497d-a232-b169a2404442 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:48.538573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1000/2027] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:48.765920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:49.009664 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9a70c-3163-47f2-ae38-17f84ad40600 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:49.011444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d5d9a70c-3163-47f2-ae38-17f84ad40600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:49.028253 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:49.041526 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d9a70c-3163-47f2-ae38-17f84ad40600 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:49.063590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:49.064825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:49.065117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:49.065392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] PATH_INFO: `/v3/projects/53cd148d7b60483184fba7acb933f24a` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:49.066697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53cd148d7b60483184fba7acb933f24a)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:49.068795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:49.219894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53cd148d7b60483184fba7acb933f24a', 'request_id': 'req-1a86b678-d75b-4edc-b70e-c7c222dd5501'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.227788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53cd148d7b60483184fba7acb933f24a', 'request_id': 'req-1a86b678-d75b-4edc-b70e-c7c222dd5501'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.235483 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53cd148d7b60483184fba7acb933f24a', 'request_id': 'req-1a86b678-d75b-4edc-b70e-c7c222dd5501'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.321159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] The token cache is being invalidate because project 53cd148d7b60483184fba7acb933f24a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:49.327129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.327129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.327129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1028/2028] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:49 2022] DELETE /identity/v3/projects/53cd148d7b60483184fba7acb933f24a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:49.329221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7780e-b883-497d-a232-b169a2404442 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:49.340514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef7780e-b883-497d-a232-b169a2404442 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:49.408219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:49.409677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:49.410232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:49.410749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] PATH_INFO: `/v3/users/a3365930d9654b628d14d4c302407831` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:49.412375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3365930d9654b628d14d4c302407831)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:49.414957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:49.467613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:49.555739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:49.568690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3365930d9654b628d14d4c302407831'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.575651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3365930d9654b628d14d4c302407831'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.576309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3365930d9654b628d14d4c302407831'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.588042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3365930d9654b628d14d4c302407831'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.588868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-427a9a9f-ccca-419d-9d03-a3d521edf9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3365930d9654b628d14d4c302407831'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:49.655984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1001/2029] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:49 2022] DELETE /identity/v3/users/a3365930d9654b628d14d4c302407831 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:50.033597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:50.057133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:50.058703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:50.072263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a86b678-d75b-4edc-b70e-c7c222dd5501 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:50.130576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:50.138129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:50.138129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:50.138129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:50.138129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] PATH_INFO: `/v3/projects/768fad8c02d44ed98e645080a5e11ae6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:50.138592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] RBAC: Authorizing `identity:delete_project(project_id=768fad8c02d44ed98e645080a5e11ae6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:50.141447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:50.336779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '768fad8c02d44ed98e645080a5e11ae6', 'request_id': 'req-19cd91e5-b343-4392-856a-73c14d97668d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:50.343004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '768fad8c02d44ed98e645080a5e11ae6', 'request_id': 'req-19cd91e5-b343-4392-856a-73c14d97668d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:50.348601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '768fad8c02d44ed98e645080a5e11ae6', 'request_id': 'req-19cd91e5-b343-4392-856a-73c14d97668d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:50.438966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] The token cache is being invalidate because project 768fad8c02d44ed98e645080a5e11ae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:50.441796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:50.441796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-19cd91e5-b343-4392-856a-73c14d97668d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:50.441796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1029/2030] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:50 2022] DELETE /identity/v3/projects/768fad8c02d44ed98e645080a5e11ae6 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:50.446211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0b53e-42b0-4141-862c-8214fd2a9d66 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:50.446656 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0b53e-42b0-4141-862c-8214fd2a9d66 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:50.446775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e0b53e-42b0-4141-862c-8214fd2a9d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:50.465858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f7e0b53e-42b0-4141-862c-8214fd2a9d66 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:50.467054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f7e0b53e-42b0-4141-862c-8214fd2a9d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:50.526155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1002/2031] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:50.534269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46078747-47c7-471d-a809-49ea95f9ce46 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:50.534576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46078747-47c7-471d-a809-49ea95f9ce46 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:50.534854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46078747-47c7-471d-a809-49ea95f9ce46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:50.555418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-46078747-47c7-471d-a809-49ea95f9ce46 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:50.556736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-46078747-47c7-471d-a809-49ea95f9ce46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:50.566105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:50.567848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1030/2032] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:50.572091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0b53e-42b0-4141-862c-8214fd2a9d66 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:50.584652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e0b53e-42b0-4141-862c-8214fd2a9d66 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:50.594298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb480b-9750-4183-8cf6-4e8e5e566124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:50.594298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb480b-9750-4183-8cf6-4e8e5e566124 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:50.594298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb480b-9750-4183-8cf6-4e8e5e566124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:50.594298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb480b-9750-4183-8cf6-4e8e5e566124 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:50.594792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb480b-9750-4183-8cf6-4e8e5e566124 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:50.594792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb480b-9750-4183-8cf6-4e8e5e566124 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:50.596068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb480b-9750-4183-8cf6-4e8e5e566124 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:50.616026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1003/2033] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:50.617559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46078747-47c7-471d-a809-49ea95f9ce46 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:50.628354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46078747-47c7-471d-a809-49ea95f9ce46 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:50.633424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1a22a-876f-4935-b7a1-16c23eb7bdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:50.634288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1a22a-876f-4935-b7a1-16c23eb7bdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:50.634564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1a22a-876f-4935-b7a1-16c23eb7bdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:50.635463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a1a22a-876f-4935-b7a1-16c23eb7bdf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:50.636155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1a22a-876f-4935-b7a1-16c23eb7bdf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:50.638192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a1a22a-876f-4935-b7a1-16c23eb7bdf7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:50.708536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1031/2034] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:50 2022] POST /identity/v3/projects => generated 381 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:50.713725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb480b-9750-4183-8cf6-4e8e5e566124 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:50.725749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb480b-9750-4183-8cf6-4e8e5e566124 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:50.790471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a78c5-ea3c-4800-bedc-d1a36f5125d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:50.791350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a78c5-ea3c-4800-bedc-d1a36f5125d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:50.791732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a78c5-ea3c-4800-bedc-d1a36f5125d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:50.792140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a78c5-ea3c-4800-bedc-d1a36f5125d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:50.793027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a78c5-ea3c-4800-bedc-d1a36f5125d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:50.795224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a78c5-ea3c-4800-bedc-d1a36f5125d6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:50.908540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1004/2035] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:50 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:50.912366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1a22a-876f-4935-b7a1-16c23eb7bdf7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:50.918943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:50.922520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a1a22a-876f-4935-b7a1-16c23eb7bdf7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:50.926982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a64ce-0b08-45b7-b509-40cbd1aab4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:50.927636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a64ce-0b08-45b7-b509-40cbd1aab4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:50.927915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a64ce-0b08-45b7-b509-40cbd1aab4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:50.928189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03a64ce-0b08-45b7-b509-40cbd1aab4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:50.928952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a64ce-0b08-45b7-b509-40cbd1aab4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:50.930612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03a64ce-0b08-45b7-b509-40cbd1aab4d7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:50.941376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1032/2036] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:50.945265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a78c5-ea3c-4800-bedc-d1a36f5125d6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:50.956125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a78c5-ea3c-4800-bedc-d1a36f5125d6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:50.961058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a85f94-fe73-47bd-9d80-dae14e88011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:50.961721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a85f94-fe73-47bd-9d80-dae14e88011f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:50.962009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a85f94-fe73-47bd-9d80-dae14e88011f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:50.962288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a85f94-fe73-47bd-9d80-dae14e88011f admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:50.963132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a85f94-fe73-47bd-9d80-dae14e88011f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:50.964726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a85f94-fe73-47bd-9d80-dae14e88011f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:50.975405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1005/2037] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:50.979513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a64ce-0b08-45b7-b509-40cbd1aab4d7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:50.988878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:50.993225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03a64ce-0b08-45b7-b509-40cbd1aab4d7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:50.998396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e84ac-c295-4a17-ad10-5312a103d172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:50.999832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e84ac-c295-4a17-ad10-5312a103d172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:51.000183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e84ac-c295-4a17-ad10-5312a103d172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:51.000426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144e84ac-c295-4a17-ad10-5312a103d172 admin admin] PATH_INFO: `/v3/projects/4a2198221bb64ac082f4e7cbfd643b35/users/10cf0262ca90419f8ecdb296a06dd0f9/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:51.015633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e84ac-c295-4a17-ad10-5312a103d172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a2198221bb64ac082f4e7cbfd643b35, user_id=10cf0262ca90419f8ecdb296a06dd0f9, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:51.018364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144e84ac-c295-4a17-ad10-5312a103d172 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:51.130814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1033/2038] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:50 2022] PUT /identity/v3/projects/4a2198221bb64ac082f4e7cbfd643b35/users/10cf0262ca90419f8ecdb296a06dd0f9/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:51.141840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6adbb-79bb-4f38-978b-a5dd9f660267 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:51.142131 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6adbb-79bb-4f38-978b-a5dd9f660267 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:51.142410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6adbb-79bb-4f38-978b-a5dd9f660267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:51.147355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:51.173458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-29f6adbb-79bb-4f38-978b-a5dd9f660267 None None] MFA Rules not processed for user `10cf0262ca90419f8ecdb296a06dd0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:51.174799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-29f6adbb-79bb-4f38-978b-a5dd9f660267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:51.243490 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1006/2039] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:51.248163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e84ac-c295-4a17-ad10-5312a103d172 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:51.267903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:51.302351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:51.313089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144e84ac-c295-4a17-ad10-5312a103d172 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:51.318013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fad8e-0cca-4dd7-9a8c-96ab50165d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:51.318668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fad8e-0cca-4dd7-9a8c-96ab50165d8b admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:51.318942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fad8e-0cca-4dd7-9a8c-96ab50165d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:51.319213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fad8e-0cca-4dd7-9a8c-96ab50165d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:51.319892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fad8e-0cca-4dd7-9a8c-96ab50165d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:51.322091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fad8e-0cca-4dd7-9a8c-96ab50165d8b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:51.440219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1034/2040] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:51 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:37:51.444128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6adbb-79bb-4f38-978b-a5dd9f660267 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:51.455575 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6adbb-79bb-4f38-978b-a5dd9f660267 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:51.474488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:51.518429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c471644-ef03-4981-906b-9a4cd5c323d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:51.519097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c471644-ef03-4981-906b-9a4cd5c323d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:51.519376 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c471644-ef03-4981-906b-9a4cd5c323d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:51.519646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c471644-ef03-4981-906b-9a4cd5c323d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:51.520341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c471644-ef03-4981-906b-9a4cd5c323d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:51.522500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c471644-ef03-4981-906b-9a4cd5c323d6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:51.632973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1007/2041] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:51 2022] POST /identity/v3/users => generated 296 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:51.637012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fad8e-0cca-4dd7-9a8c-96ab50165d8b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:51.639296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:51.650157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fad8e-0cca-4dd7-9a8c-96ab50165d8b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:51.654882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e75bb-8b9f-4e95-9a5f-7b6d44afd780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:51.655532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e75bb-8b9f-4e95-9a5f-7b6d44afd780 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:51.656618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e75bb-8b9f-4e95-9a5f-7b6d44afd780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:51.656920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e75bb-8b9f-4e95-9a5f-7b6d44afd780 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:51.657640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e75bb-8b9f-4e95-9a5f-7b6d44afd780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:51.659230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e75bb-8b9f-4e95-9a5f-7b6d44afd780 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:51.669543 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1035/2042] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:51.676404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c471644-ef03-4981-906b-9a4cd5c323d6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:51.684066 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c471644-ef03-4981-906b-9a4cd5c323d6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:51.689177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dd6d9-ff72-436e-8969-3fd7f93fd344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:51.690073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dd6d9-ff72-436e-8969-3fd7f93fd344 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:51.690355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dd6d9-ff72-436e-8969-3fd7f93fd344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:51.690633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dd6d9-ff72-436e-8969-3fd7f93fd344 admin admin] PATH_INFO: `/v3/projects/9e34e93ee900411ab14662e7399c3d45/users/bcccf301997d4fd2b4ce3d720167b97f/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:51.707496 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dd6d9-ff72-436e-8969-3fd7f93fd344 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e34e93ee900411ab14662e7399c3d45, user_id=bcccf301997d4fd2b4ce3d720167b97f, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:51.710209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dd6d9-ff72-436e-8969-3fd7f93fd344 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:51.829228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1008/2043] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:51 2022] PUT /identity/v3/projects/9e34e93ee900411ab14662e7399c3d45/users/bcccf301997d4fd2b4ce3d720167b97f/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:51.833642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e75bb-8b9f-4e95-9a5f-7b6d44afd780 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:51.838762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:51.844682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e75bb-8b9f-4e95-9a5f-7b6d44afd780 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:51.900842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6ea501-7108-454f-b5af-9679801460a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:51.901508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ea501-7108-454f-b5af-9679801460a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:51.901793 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ea501-7108-454f-b5af-9679801460a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:51.902072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6ea501-7108-454f-b5af-9679801460a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:51.902799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ea501-7108-454f-b5af-9679801460a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:51.904406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6ea501-7108-454f-b5af-9679801460a1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:51.913943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1036/2044] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:51.918120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dd6d9-ff72-436e-8969-3fd7f93fd344 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:51.928948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dd6d9-ff72-436e-8969-3fd7f93fd344 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:51.933610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf55d-3a5e-459a-a7b0-52dbeb4fb54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:51.934562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf55d-3a5e-459a-a7b0-52dbeb4fb54a admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:51.934844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf55d-3a5e-459a-a7b0-52dbeb4fb54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:51.935119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf55d-3a5e-459a-a7b0-52dbeb4fb54a admin admin] PATH_INFO: `/v3/projects/9e34e93ee900411ab14662e7399c3d45/users/bcccf301997d4fd2b4ce3d720167b97f/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:51.937643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cf55d-3a5e-459a-a7b0-52dbeb4fb54a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e34e93ee900411ab14662e7399c3d45, user_id=bcccf301997d4fd2b4ce3d720167b97f, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:51.940368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cf55d-3a5e-459a-a7b0-52dbeb4fb54a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:51.950550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1009/2045] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:51 2022] PUT /identity/v3/projects/9e34e93ee900411ab14662e7399c3d45/users/bcccf301997d4fd2b4ce3d720167b97f/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:51.962226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed280c56-ea70-44ce-9172-69a22f5df176 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:51.962524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed280c56-ea70-44ce-9172-69a22f5df176 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:51.962807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed280c56-ea70-44ce-9172-69a22f5df176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:51.990054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ed280c56-ea70-44ce-9172-69a22f5df176 None None] MFA Rules not processed for user `bcccf301997d4fd2b4ce3d720167b97f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:51.991258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ed280c56-ea70-44ce-9172-69a22f5df176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:52.066479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1037/2046] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:52.078436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf55d-3a5e-459a-a7b0-52dbeb4fb54a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:52.080211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8a3cf55d-3a5e-459a-a7b0-52dbeb4fb54a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:52.140106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf55d-3a5e-459a-a7b0-52dbeb4fb54a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:52.143669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd45e3a-f0d3-4917-8c7c-a7d4a1d7386e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:52.144311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd45e3a-f0d3-4917-8c7c-a7d4a1d7386e service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:52.144659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd45e3a-f0d3-4917-8c7c-a7d4a1d7386e service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:52.144937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd45e3a-f0d3-4917-8c7c-a7d4a1d7386e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:52.153895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd45e3a-f0d3-4917-8c7c-a7d4a1d7386e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:52.155405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd45e3a-f0d3-4917-8c7c-a7d4a1d7386e service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:52.165074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1010/2047] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:52.422168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed280c56-ea70-44ce-9172-69a22f5df176 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:52.431538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed280c56-ea70-44ce-9172-69a22f5df176 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:52.435066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f74b49-8917-4978-8b59-0e96440b5025 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:52.435699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f74b49-8917-4978-8b59-0e96440b5025 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:52.435980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f74b49-8917-4978-8b59-0e96440b5025 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:52.436281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f74b49-8917-4978-8b59-0e96440b5025 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:52.478870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:52.494810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f74b49-8917-4978-8b59-0e96440b5025 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:52.496292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f74b49-8917-4978-8b59-0e96440b5025 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:52.506386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1038/2048] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:56.646697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd45e3a-f0d3-4917-8c7c-a7d4a1d7386e service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:56.656425 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd45e3a-f0d3-4917-8c7c-a7d4a1d7386e service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:56.660382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba56f1a-5ff1-4e53-8f91-82e1b803fc2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:56.661985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba56f1a-5ff1-4e53-8f91-82e1b803fc2f service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:56.661985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba56f1a-5ff1-4e53-8f91-82e1b803fc2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:56.661985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba56f1a-5ff1-4e53-8f91-82e1b803fc2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:56.663657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4ba56f1a-5ff1-4e53-8f91-82e1b803fc2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:56.719143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:56.735099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba56f1a-5ff1-4e53-8f91-82e1b803fc2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:56.736672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba56f1a-5ff1-4e53-8f91-82e1b803fc2f service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:56.746357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1011/2049] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:57.587588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f74b49-8917-4978-8b59-0e96440b5025 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:57.588419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-69f74b49-8917-4978-8b59-0e96440b5025 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:57.665022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f74b49-8917-4978-8b59-0e96440b5025 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:57.669981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:57.672626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:57.672921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:57.673296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] PATH_INFO: `/v3/users/87839dbb01b84734b7e44e4e619cc123` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:57.674734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=87839dbb01b84734b7e44e4e619cc123)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:57.676946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:57.929366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87839dbb01b84734b7e44e4e619cc123'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:57.942637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87839dbb01b84734b7e44e4e619cc123'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:58.010172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87839dbb01b84734b7e44e4e619cc123'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:58.011028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87839dbb01b84734b7e44e4e619cc123'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:58.011726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87839dbb01b84734b7e44e4e619cc123'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:58.026296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1039/2050] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:37:57 2022] DELETE /identity/v3/users/87839dbb01b84734b7e44e4e619cc123 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:58.031677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242682b1-6fd0-418f-a3b8-e87522cc4b99 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:58.032207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242682b1-6fd0-418f-a3b8-e87522cc4b99 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:58.032322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242682b1-6fd0-418f-a3b8-e87522cc4b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:58.051303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-242682b1-6fd0-418f-a3b8-e87522cc4b99 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:58.052673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-242682b1-6fd0-418f-a3b8-e87522cc4b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:58.119120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1012/2051] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:58.130013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:58.131571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:58.189912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5a195-b259-488f-8968-70b85074ec1c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:58.193586 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c7e1a6-b52e-406c-bcff-af34df2bf4da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:58.194173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7e1a6-b52e-406c-bcff-af34df2bf4da service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:58.194454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7e1a6-b52e-406c-bcff-af34df2bf4da service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:58.194724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c7e1a6-b52e-406c-bcff-af34df2bf4da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:58.204814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7e1a6-b52e-406c-bcff-af34df2bf4da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:58.206246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c7e1a6-b52e-406c-bcff-af34df2bf4da service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:58.215598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1040/2052] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:37:58.669667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242682b1-6fd0-418f-a3b8-e87522cc4b99 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:58.671310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-242682b1-6fd0-418f-a3b8-e87522cc4b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:58.688245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242682b1-6fd0-418f-a3b8-e87522cc4b99 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:58.694253 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:58.694963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:58.695233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:58.695512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] PATH_INFO: `/v3/projects/3b53c767a60047fca5fee1466c88ddad` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:58.696883 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b53c767a60047fca5fee1466c88ddad)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:58.698781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:58.793524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b53c767a60047fca5fee1466c88ddad', 'request_id': 'req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:58.800378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b53c767a60047fca5fee1466c88ddad', 'request_id': 'req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:58.806037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b53c767a60047fca5fee1466c88ddad', 'request_id': 'req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:58.889388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] The token cache is being invalidate because project 3b53c767a60047fca5fee1466c88ddad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:37:58.889708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:58.890859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0eedf97b-cd41-4d68-ab59-8652fa1a1f86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:37:58.892407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1013/2053] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:37:58 2022] DELETE /identity/v3/projects/3b53c767a60047fca5fee1466c88ddad => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:37:58.897530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ede37-ef64-4067-8793-bc2291c2e2bb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:58.898020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ede37-ef64-4067-8793-bc2291c2e2bb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:58.898113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ede37-ef64-4067-8793-bc2291c2e2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:58.905237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:58.916382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e53ede37-ef64-4067-8793-bc2291c2e2bb None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:58.917601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e53ede37-ef64-4067-8793-bc2291c2e2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:58.979203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1041/2054] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:58.988834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ef264-c5eb-4a98-bb9b-d4049d4f9829 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:58.989129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ef264-c5eb-4a98-bb9b-d4049d4f9829 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:58.989414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357ef264-c5eb-4a98-bb9b-d4049d4f9829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:59.007866 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-357ef264-c5eb-4a98-bb9b-d4049d4f9829 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:59.009100 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-357ef264-c5eb-4a98-bb9b-d4049d4f9829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:59.017714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1014/2055] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:59.022074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ede37-ef64-4067-8793-bc2291c2e2bb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:59.032420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ede37-ef64-4067-8793-bc2291c2e2bb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:59.036997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927b15c-ec17-4a22-8bbb-9950c02ec426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:59.038804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b15c-ec17-4a22-8bbb-9950c02ec426 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:59.038804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b15c-ec17-4a22-8bbb-9950c02ec426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:59.038804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b15c-ec17-4a22-8bbb-9950c02ec426 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:59.039039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927b15c-ec17-4a22-8bbb-9950c02ec426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:37:59.039274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927b15c-ec17-4a22-8bbb-9950c02ec426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:59.040914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927b15c-ec17-4a22-8bbb-9950c02ec426 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:59.052315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1042/2056] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:37:59.056602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ef264-c5eb-4a98-bb9b-d4049d4f9829 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:59.065838 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357ef264-c5eb-4a98-bb9b-d4049d4f9829 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:59.070483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85377ab-5948-4ae5-b159-b4e6b8661823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:59.071135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85377ab-5948-4ae5-b159-b4e6b8661823 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:59.071420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85377ab-5948-4ae5-b159-b4e6b8661823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:59.071703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85377ab-5948-4ae5-b159-b4e6b8661823 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:59.072392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85377ab-5948-4ae5-b159-b4e6b8661823 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:59.074321 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85377ab-5948-4ae5-b159-b4e6b8661823 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:59.182803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1015/2057] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:37:59 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:59.187035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927b15c-ec17-4a22-8bbb-9950c02ec426 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:59.196827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927b15c-ec17-4a22-8bbb-9950c02ec426 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:59.254688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e398f38-62c5-4d0f-a478-37dd193cb247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:59.255267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e398f38-62c5-4d0f-a478-37dd193cb247 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:59.255548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e398f38-62c5-4d0f-a478-37dd193cb247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:59.255849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e398f38-62c5-4d0f-a478-37dd193cb247 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:59.256563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e398f38-62c5-4d0f-a478-37dd193cb247 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:59.258571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e398f38-62c5-4d0f-a478-37dd193cb247 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:59.341588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1043/2058] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:37:59 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:37:59.345813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85377ab-5948-4ae5-b159-b4e6b8661823 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:59.356209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85377ab-5948-4ae5-b159-b4e6b8661823 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:59.361126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24f755-0280-4a7c-aaa5-c7122c0bcc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:59.361786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24f755-0280-4a7c-aaa5-c7122c0bcc5a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:59.362075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24f755-0280-4a7c-aaa5-c7122c0bcc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:59.362353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24f755-0280-4a7c-aaa5-c7122c0bcc5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:59.363134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24f755-0280-4a7c-aaa5-c7122c0bcc5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:59.364781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24f755-0280-4a7c-aaa5-c7122c0bcc5a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:59.375617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1016/2059] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:59.379518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e398f38-62c5-4d0f-a478-37dd193cb247 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:59.389837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e398f38-62c5-4d0f-a478-37dd193cb247 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:59.395049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54689667-7df7-46bb-a944-abd9560f688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:59.395707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54689667-7df7-46bb-a944-abd9560f688f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:59.395996 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54689667-7df7-46bb-a944-abd9560f688f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:59.396273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54689667-7df7-46bb-a944-abd9560f688f admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:59.397030 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54689667-7df7-46bb-a944-abd9560f688f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:59.398639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54689667-7df7-46bb-a944-abd9560f688f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:59.409254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1044/2060] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:37:59.413088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24f755-0280-4a7c-aaa5-c7122c0bcc5a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:59.423288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24f755-0280-4a7c-aaa5-c7122c0bcc5a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:59.427892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ae862-9cfe-4eb0-be0a-53980ee49d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:59.428806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ae862-9cfe-4eb0-be0a-53980ee49d4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:59.429093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ae862-9cfe-4eb0-be0a-53980ee49d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:59.429580 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4ae862-9cfe-4eb0-be0a-53980ee49d4e admin admin] PATH_INFO: `/v3/projects/bc97a33f76124d90bb62a2d7f4bf5e07/users/cfd436137b5a4cce94b88e4ffa9fda72/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:59.445063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ae862-9cfe-4eb0-be0a-53980ee49d4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc97a33f76124d90bb62a2d7f4bf5e07, user_id=cfd436137b5a4cce94b88e4ffa9fda72, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:59.447723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4ae862-9cfe-4eb0-be0a-53980ee49d4e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:59.583006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1017/2061] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:37:59 2022] PUT /identity/v3/projects/bc97a33f76124d90bb62a2d7f4bf5e07/users/cfd436137b5a4cce94b88e4ffa9fda72/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:37:59.602013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61f28-8fa2-4667-9cd6-344b2b854eb7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:59.602333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61f28-8fa2-4667-9cd6-344b2b854eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:59.602655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb61f28-8fa2-4667-9cd6-344b2b854eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:59.631718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4eb61f28-8fa2-4667-9cd6-344b2b854eb7 None None] MFA Rules not processed for user `cfd436137b5a4cce94b88e4ffa9fda72`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:37:59.633028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4eb61f28-8fa2-4667-9cd6-344b2b854eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:59.697069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:59.702803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1045/2062] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:37:59 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:37:59.717106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ae862-9cfe-4eb0-be0a-53980ee49d4e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:37:59.719161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8c4ae862-9cfe-4eb0-be0a-53980ee49d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:37:59.726763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:59.786804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4ae862-9cfe-4eb0-be0a-53980ee49d4e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:37:59.791179 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03c8d7-8946-488e-a4e6-eee1413e9471 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:37:59.791948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03c8d7-8946-488e-a4e6-eee1413e9471 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:37:59.792778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03c8d7-8946-488e-a4e6-eee1413e9471 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:37:59.792778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03c8d7-8946-488e-a4e6-eee1413e9471 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:37:59.804022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03c8d7-8946-488e-a4e6-eee1413e9471 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:37:59.805819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03c8d7-8946-488e-a4e6-eee1413e9471 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:37:59.818773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1018/2063] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:37:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:06.479696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb61f28-8fa2-4667-9cd6-344b2b854eb7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:06.562710 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb61f28-8fa2-4667-9cd6-344b2b854eb7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:06.567746 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:06.568807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:06.569088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:06.570509 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] PATH_INFO: `/v3/users/cfd436137b5a4cce94b88e4ffa9fda72` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:06.571725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfd436137b5a4cce94b88e4ffa9fda72)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:06.573734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:06.739051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfd436137b5a4cce94b88e4ffa9fda72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:06.751657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfd436137b5a4cce94b88e4ffa9fda72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:06.827345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfd436137b5a4cce94b88e4ffa9fda72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:06.828617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfd436137b5a4cce94b88e4ffa9fda72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:06.829254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfd436137b5a4cce94b88e4ffa9fda72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:06.844221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1046/2064] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:06 2022] DELETE /identity/v3/users/cfd436137b5a4cce94b88e4ffa9fda72 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:06.848958 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f1d8-bc6f-4626-818b-23e5a2917e08 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:06.849463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f1d8-bc6f-4626-818b-23e5a2917e08 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:06.849619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f1d8-bc6f-4626-818b-23e5a2917e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:06.867919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6aa3f1d8-bc6f-4626-818b-23e5a2917e08 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:06.869129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6aa3f1d8-bc6f-4626-818b-23e5a2917e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:06.935631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1019/2065] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:38:06.946337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:06.947895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:07.033839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f54daa-df7a-46b4-8782-bdfe998ee82b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:07.033839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc655c56-4e01-461e-9082-81b2bba1ade6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:07.033839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655c56-4e01-461e-9082-81b2bba1ade6 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:07.033839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655c56-4e01-461e-9082-81b2bba1ade6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:07.034308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc655c56-4e01-461e-9082-81b2bba1ade6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:07.043385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc655c56-4e01-461e-9082-81b2bba1ade6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:07.045170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc655c56-4e01-461e-9082-81b2bba1ade6 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:07.056372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1047/2066] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:07.549703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3f1d8-bc6f-4626-818b-23e5a2917e08 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:07.556685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6aa3f1d8-bc6f-4626-818b-23e5a2917e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:07.565663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3f1d8-bc6f-4626-818b-23e5a2917e08 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:07.570707 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:07.571670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:07.572023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:07.572375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] PATH_INFO: `/v3/projects/bc97a33f76124d90bb62a2d7f4bf5e07` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:07.573699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc97a33f76124d90bb62a2d7f4bf5e07)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:07.576072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:07.719697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc97a33f76124d90bb62a2d7f4bf5e07', 'request_id': 'req-70bbff53-3a12-4a39-b01f-bd7c56a3843b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:07.726364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc97a33f76124d90bb62a2d7f4bf5e07', 'request_id': 'req-70bbff53-3a12-4a39-b01f-bd7c56a3843b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:07.732120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc97a33f76124d90bb62a2d7f4bf5e07', 'request_id': 'req-70bbff53-3a12-4a39-b01f-bd7c56a3843b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:07.872849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] The token cache is being invalidate because project bc97a33f76124d90bb62a2d7f4bf5e07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:07.873478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:07.873657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-70bbff53-3a12-4a39-b01f-bd7c56a3843b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:07.875429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1020/2067] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:07 2022] DELETE /identity/v3/projects/bc97a33f76124d90bb62a2d7f4bf5e07 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:07.880377 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145392b-cd73-4e22-ac4b-a50dc08488b0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:07.880833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145392b-cd73-4e22-ac4b-a50dc08488b0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:07.880944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145392b-cd73-4e22-ac4b-a50dc08488b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:07.899018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b145392b-cd73-4e22-ac4b-a50dc08488b0 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:07.900373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b145392b-cd73-4e22-ac4b-a50dc08488b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:07.917866 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:07.960024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1048/2068] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:07.969580 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c550-c5a4-458d-8780-b4e6a1e4257e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:07.969954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c550-c5a4-458d-8780-b4e6a1e4257e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:07.970145 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c550-c5a4-458d-8780-b4e6a1e4257e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:07.988953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d5b0c550-c5a4-458d-8780-b4e6a1e4257e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:07.990172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d5b0c550-c5a4-458d-8780-b4e6a1e4257e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:07.998316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1021/2069] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:08.003333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145392b-cd73-4e22-ac4b-a50dc08488b0 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:08.013292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145392b-cd73-4e22-ac4b-a50dc08488b0 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:08.019260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6cf62-2b38-40c9-95ff-a45b51504fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:08.019952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6cf62-2b38-40c9-95ff-a45b51504fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:08.020278 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6cf62-2b38-40c9-95ff-a45b51504fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:08.020918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6cf62-2b38-40c9-95ff-a45b51504fcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:08.021650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6cf62-2b38-40c9-95ff-a45b51504fcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:38:08.021959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6cf62-2b38-40c9-95ff-a45b51504fcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:08.023568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6cf62-2b38-40c9-95ff-a45b51504fcb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:08.036027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1049/2070] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:38:08.040517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c550-c5a4-458d-8780-b4e6a1e4257e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:08.051846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c550-c5a4-458d-8780-b4e6a1e4257e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:08.059504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdc66-d2c2-40f6-bfc0-0ceaf0167178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:08.059504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdc66-d2c2-40f6-bfc0-0ceaf0167178 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:08.059504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdc66-d2c2-40f6-bfc0-0ceaf0167178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:08.059504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7fdc66-d2c2-40f6-bfc0-0ceaf0167178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:08.059896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fdc66-d2c2-40f6-bfc0-0ceaf0167178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:08.061547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7fdc66-d2c2-40f6-bfc0-0ceaf0167178 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:08.208559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1022/2071] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:08 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:08.210505 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6cf62-2b38-40c9-95ff-a45b51504fcb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:08.220910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6cf62-2b38-40c9-95ff-a45b51504fcb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:08.277539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a22331-a902-4a7d-bf50-d673e21b4d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:08.278199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a22331-a902-4a7d-bf50-d673e21b4d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:08.278478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a22331-a902-4a7d-bf50-d673e21b4d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:08.278749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a22331-a902-4a7d-bf50-d673e21b4d12 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:08.279428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a22331-a902-4a7d-bf50-d673e21b4d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:08.281902 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a22331-a902-4a7d-bf50-d673e21b4d12 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:08.395138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1050/2072] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:08 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:08.396245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdc66-d2c2-40f6-bfc0-0ceaf0167178 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:08.401991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:08.408392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7fdc66-d2c2-40f6-bfc0-0ceaf0167178 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:08.413857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c175-30bd-432c-b438-404b9746c62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:08.414630 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c175-30bd-432c-b438-404b9746c62e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:08.414980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c175-30bd-432c-b438-404b9746c62e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:08.415475 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c88c175-30bd-432c-b438-404b9746c62e admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:08.416297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c175-30bd-432c-b438-404b9746c62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:08.418137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c88c175-30bd-432c-b438-404b9746c62e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:08.430368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1023/2073] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:08.434407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a22331-a902-4a7d-bf50-d673e21b4d12 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:08.444400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a22331-a902-4a7d-bf50-d673e21b4d12 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:08.449249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad393e25-6761-4b50-8c96-cbd93208642f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:08.449956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393e25-6761-4b50-8c96-cbd93208642f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:08.450264 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393e25-6761-4b50-8c96-cbd93208642f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:08.450539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad393e25-6761-4b50-8c96-cbd93208642f admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:08.451661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad393e25-6761-4b50-8c96-cbd93208642f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:08.453477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad393e25-6761-4b50-8c96-cbd93208642f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:08.464053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1051/2074] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:38:08.468973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c175-30bd-432c-b438-404b9746c62e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:08.479056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c88c175-30bd-432c-b438-404b9746c62e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:08.484462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0383b9f-b49d-4c1c-88b8-68468bb3d003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:08.495010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0383b9f-b49d-4c1c-88b8-68468bb3d003 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:08.495010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0383b9f-b49d-4c1c-88b8-68468bb3d003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:08.495010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0383b9f-b49d-4c1c-88b8-68468bb3d003 admin admin] PATH_INFO: `/v3/projects/7605f4d77c824db5aab82cc339d21482/users/28865c0adc1d496182eb223d818d304d/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:08.501558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0383b9f-b49d-4c1c-88b8-68468bb3d003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7605f4d77c824db5aab82cc339d21482, user_id=28865c0adc1d496182eb223d818d304d, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:08.504222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0383b9f-b49d-4c1c-88b8-68468bb3d003 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:08.582349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1024/2075] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:08 2022] PUT /identity/v3/projects/7605f4d77c824db5aab82cc339d21482/users/28865c0adc1d496182eb223d818d304d/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:08.597336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275bdc6-f69c-4d67-a55d-5fbe106c43cc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:08.597519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275bdc6-f69c-4d67-a55d-5fbe106c43cc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:08.597858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275bdc6-f69c-4d67-a55d-5fbe106c43cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:08.635087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3275bdc6-f69c-4d67-a55d-5fbe106c43cc None None] MFA Rules not processed for user `28865c0adc1d496182eb223d818d304d`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:08.636289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3275bdc6-f69c-4d67-a55d-5fbe106c43cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:08.712410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1052/2076] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:08.724643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0383b9f-b49d-4c1c-88b8-68468bb3d003 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:08.726348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c0383b9f-b49d-4c1c-88b8-68468bb3d003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:08.804776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0383b9f-b49d-4c1c-88b8-68468bb3d003 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:08.808828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d716f1-9fcd-406d-b9c2-0ad841893c6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:08.809484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d716f1-9fcd-406d-b9c2-0ad841893c6c service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:08.809781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d716f1-9fcd-406d-b9c2-0ad841893c6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:08.810035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d716f1-9fcd-406d-b9c2-0ad841893c6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:08.832778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d716f1-9fcd-406d-b9c2-0ad841893c6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:08.834193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d716f1-9fcd-406d-b9c2-0ad841893c6c service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:08.844316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1025/2077] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:09.373885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275bdc6-f69c-4d67-a55d-5fbe106c43cc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:09.375705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3275bdc6-f69c-4d67-a55d-5fbe106c43cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:09.380386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:09.471128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275bdc6-f69c-4d67-a55d-5fbe106c43cc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:09.476042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:09.477036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:09.477350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:09.477623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] PATH_INFO: `/v3/users/10cf0262ca90419f8ecdb296a06dd0f9` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:09.478827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10cf0262ca90419f8ecdb296a06dd0f9)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:09.481080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:09.671537 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10cf0262ca90419f8ecdb296a06dd0f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:09.683787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10cf0262ca90419f8ecdb296a06dd0f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:09.733040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d716f1-9fcd-406d-b9c2-0ad841893c6c service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:09.735030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-37d716f1-9fcd-406d-b9c2-0ad841893c6c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:09.749816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d716f1-9fcd-406d-b9c2-0ad841893c6c service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:09.754677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:09.755658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:09.755977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:09.756307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] PATH_INFO: `/v3/users/5f0c551208b74836b7778c24eb3cacee` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:09.757650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0c551208b74836b7778c24eb3cacee)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:09.759645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:09.832591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10cf0262ca90419f8ecdb296a06dd0f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:09.833205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10cf0262ca90419f8ecdb296a06dd0f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:09.833814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3c5bba2d-6f18-4c78-8b1a-5705fd80bc34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10cf0262ca90419f8ecdb296a06dd0f9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:09.846669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1053/2078] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:09 2022] DELETE /identity/v3/users/10cf0262ca90419f8ecdb296a06dd0f9 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:09.866663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fe9d2-70f2-47bc-b8ef-572af13c35c8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:09.866903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fe9d2-70f2-47bc-b8ef-572af13c35c8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:09.867186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22fe9d2-70f2-47bc-b8ef-572af13c35c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:09.884488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e22fe9d2-70f2-47bc-b8ef-572af13c35c8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:09.885686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e22fe9d2-70f2-47bc-b8ef-572af13c35c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:09.931623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:09.945780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1054/2079] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:38:09.974606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fe9d2-70f2-47bc-b8ef-572af13c35c8 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:09.976023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e22fe9d2-70f2-47bc-b8ef-572af13c35c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:10.059685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22fe9d2-70f2-47bc-b8ef-572af13c35c8 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:10.064261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807200b6-7b35-4d9c-8794-534fa22f08e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:10.065010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807200b6-7b35-4d9c-8794-534fa22f08e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:10.065378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807200b6-7b35-4d9c-8794-534fa22f08e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:10.065583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807200b6-7b35-4d9c-8794-534fa22f08e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:10.075109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807200b6-7b35-4d9c-8794-534fa22f08e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:10.076575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807200b6-7b35-4d9c-8794-534fa22f08e1 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:10.086784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1055/2080] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:38:10.112365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0c551208b74836b7778c24eb3cacee'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:10.120144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0c551208b74836b7778c24eb3cacee'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:10.120796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0c551208b74836b7778c24eb3cacee'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:10.134666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0c551208b74836b7778c24eb3cacee'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:10.135455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0c551208b74836b7778c24eb3cacee'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:10.307560 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1026/2081] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:09 2022] DELETE /identity/v3/users/5f0c551208b74836b7778c24eb3cacee => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:10.312668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d56a-74ef-433d-bc6b-4451abd03b9c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:10.312959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d56a-74ef-433d-bc6b-4451abd03b9c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:10.313237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d56a-74ef-433d-bc6b-4451abd03b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:10.330476 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f8f7d56a-74ef-433d-bc6b-4451abd03b9c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:10.331671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f8f7d56a-74ef-433d-bc6b-4451abd03b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:10.392080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1056/2082] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:10.401886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:10.403552 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:10.414698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:10.467364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9be59e-2336-4d43-93a8-2dbc5adfac98 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:10.471286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6c30-9caa-4487-a366-fc0464970fd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:10.471937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6c30-9caa-4487-a366-fc0464970fd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:10.472220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6c30-9caa-4487-a366-fc0464970fd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:10.472533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f6c30-9caa-4487-a366-fc0464970fd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:10.482265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f6c30-9caa-4487-a366-fc0464970fd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:10.484516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f6c30-9caa-4487-a366-fc0464970fd9 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:10.494563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1027/2083] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:10.739224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d56a-74ef-433d-bc6b-4451abd03b9c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:10.740821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f8f7d56a-74ef-433d-bc6b-4451abd03b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:10.775088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d56a-74ef-433d-bc6b-4451abd03b9c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:10.783749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:10.784629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:10.784915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:10.785197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] PATH_INFO: `/v3/projects/4a2198221bb64ac082f4e7cbfd643b35` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:10.787803 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a2198221bb64ac082f4e7cbfd643b35)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:10.790564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:10.960204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a2198221bb64ac082f4e7cbfd643b35', 'request_id': 'req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:10.966378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a2198221bb64ac082f4e7cbfd643b35', 'request_id': 'req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:10.975638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a2198221bb64ac082f4e7cbfd643b35', 'request_id': 'req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.036802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6c30-9caa-4487-a366-fc0464970fd9 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:11.038380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fe0f6c30-9caa-4487-a366-fc0464970fd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:11.057161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f6c30-9caa-4487-a366-fc0464970fd9 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:11.092039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:11.097231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] The token cache is being invalidate because project 4a2198221bb64ac082f4e7cbfd643b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:11.097522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.099633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.099769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1057/2084] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:10 2022] DELETE /identity/v3/projects/4a2198221bb64ac082f4e7cbfd643b35 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:11.103609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:11.105040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:11.120779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:11.121663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:11.121946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:11.122216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] PATH_INFO: `/v3/projects/be56beb81c88493794dc0c8f0ea3b81b` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:11.123498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be56beb81c88493794dc0c8f0ea3b81b)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:11.125532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:11.170821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60d0d9-a567-4fdb-a714-ee2296a88d0d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:11.176240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:11.177136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:11.177417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:11.177691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] PATH_INFO: `/v3/users/bcccf301997d4fd2b4ce3d720167b97f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:11.178882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcccf301997d4fd2b4ce3d720167b97f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:11.181033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:11.245567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be56beb81c88493794dc0c8f0ea3b81b', 'request_id': 'req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.252328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be56beb81c88493794dc0c8f0ea3b81b', 'request_id': 'req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.258030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be56beb81c88493794dc0c8f0ea3b81b', 'request_id': 'req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.347354 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] The token cache is being invalidate because project be56beb81c88493794dc0c8f0ea3b81b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:11.347641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.348272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.350020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1028/2085] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:11 2022] DELETE /identity/v3/projects/be56beb81c88493794dc0c8f0ea3b81b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:11.353630 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:11.354935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:11.400275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:11.418058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcccf301997d4fd2b4ce3d720167b97f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.418888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb946d-5ecc-4015-bc7e-c8ddef9167b6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:11.424228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:11.425120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:11.425400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:11.425673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] PATH_INFO: `/v3/users/9acd77b781c74132a91172dbd7be59ca` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:11.426906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9acd77b781c74132a91172dbd7be59ca)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:11.428845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:11.431293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcccf301997d4fd2b4ce3d720167b97f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.495817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcccf301997d4fd2b4ce3d720167b97f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.496380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcccf301997d4fd2b4ce3d720167b97f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.497095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcccf301997d4fd2b4ce3d720167b97f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.511073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1058/2086] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:11 2022] DELETE /identity/v3/users/bcccf301997d4fd2b4ce3d720167b97f => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:11.620385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9acd77b781c74132a91172dbd7be59ca'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.628207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9acd77b781c74132a91172dbd7be59ca'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.628921 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9acd77b781c74132a91172dbd7be59ca'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.640741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9acd77b781c74132a91172dbd7be59ca'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.641393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9acd77b781c74132a91172dbd7be59ca'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:11.737297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1029/2087] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:11 2022] DELETE /identity/v3/users/9acd77b781c74132a91172dbd7be59ca => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:12.060231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:12.062525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:12.144663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783da53-7e7f-4189-9c65-926e2dddd3e8 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:12.177392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:12.202184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:12.203684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:12.210394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:12.210829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:12.211115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:12.211397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] PATH_INFO: `/v3/projects/9e34e93ee900411ab14662e7399c3d45` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:12.212617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e34e93ee900411ab14662e7399c3d45)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:12.214554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:12.271576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105027df-eedc-4188-a57e-2f800841e536 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:12.276015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:12.276917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:12.277198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:12.277474 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] PATH_INFO: `/v3/users/2212df5c2d5340b197a309a327cfa295` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:12.278685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2212df5c2d5340b197a309a327cfa295)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:12.281267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:12.413176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e34e93ee900411ab14662e7399c3d45', 'request_id': 'req-30471a72-8dab-4927-89b8-cc6ec83d57e4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.419802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e34e93ee900411ab14662e7399c3d45', 'request_id': 'req-30471a72-8dab-4927-89b8-cc6ec83d57e4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.426287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e34e93ee900411ab14662e7399c3d45', 'request_id': 'req-30471a72-8dab-4927-89b8-cc6ec83d57e4'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.569930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] The token cache is being invalidate because project 9e34e93ee900411ab14662e7399c3d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:12.570153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.570766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.572392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1059/2088] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:12 2022] DELETE /identity/v3/projects/9e34e93ee900411ab14662e7399c3d45 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:12.573300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:12.574554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:12.625240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2212df5c2d5340b197a309a327cfa295'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.632715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2212df5c2d5340b197a309a327cfa295'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.633381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2212df5c2d5340b197a309a327cfa295'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.638636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:12.639267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30471a72-8dab-4927-89b8-cc6ec83d57e4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:12.644835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:12.645721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:12.646001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:12.646276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] PATH_INFO: `/v3/projects/198ae951926f4440b14132e94ae656de` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:12.646922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2212df5c2d5340b197a309a327cfa295'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.647450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] RBAC: Authorizing `identity:delete_project(project_id=198ae951926f4440b14132e94ae656de)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:12.647749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-09946044-f8c7-49e5-8324-1ce239a18616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2212df5c2d5340b197a309a327cfa295'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.649415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:12.747461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1030/2089] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:12 2022] DELETE /identity/v3/users/2212df5c2d5340b197a309a327cfa295 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:12.748816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb7d4-dfb5-4ffc-a6b9-bb8b388fd62e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:12.749104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb7d4-dfb5-4ffc-a6b9-bb8b388fd62e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:12.749385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42edb7d4-dfb5-4ffc-a6b9-bb8b388fd62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:12.767399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-42edb7d4-dfb5-4ffc-a6b9-bb8b388fd62e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:12.769512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-42edb7d4-dfb5-4ffc-a6b9-bb8b388fd62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:12.800095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '198ae951926f4440b14132e94ae656de', 'request_id': 'req-9ff404ee-14a6-4921-bb83-60328994deea'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.806639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '198ae951926f4440b14132e94ae656de', 'request_id': 'req-9ff404ee-14a6-4921-bb83-60328994deea'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.810630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:12.812887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '198ae951926f4440b14132e94ae656de', 'request_id': 'req-9ff404ee-14a6-4921-bb83-60328994deea'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.833067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1031/2090] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:12.834353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e73638-8553-43d6-9987-0c95ddf64208 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:12.834645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e73638-8553-43d6-9987-0c95ddf64208 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:12.834917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e73638-8553-43d6-9987-0c95ddf64208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:12.851550 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-12e73638-8553-43d6-9987-0c95ddf64208 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:12.852768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-12e73638-8553-43d6-9987-0c95ddf64208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:12.896038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] The token cache is being invalidate because project 198ae951926f4440b14132e94ae656de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:12.896470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.897199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9ff404ee-14a6-4921-bb83-60328994deea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:12.903134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1060/2091] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:12 2022] DELETE /identity/v3/projects/198ae951926f4440b14132e94ae656de => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:12.903134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41322e-a119-4f33-9760-f1db5d44f0f7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:12.903134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41322e-a119-4f33-9760-f1db5d44f0f7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:12.903134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c41322e-a119-4f33-9760-f1db5d44f0f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:12.912997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1032/2092] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:12.914390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905717e7-382b-4217-bffc-4242da4b8049 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:12.914758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905717e7-382b-4217-bffc-4242da4b8049 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:12.915095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905717e7-382b-4217-bffc-4242da4b8049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:12.921431 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4c41322e-a119-4f33-9760-f1db5d44f0f7 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:12.922703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4c41322e-a119-4f33-9760-f1db5d44f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:12.932060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1061/2093] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:12.933027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41322e-a119-4f33-9760-f1db5d44f0f7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:12.934356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-905717e7-382b-4217-bffc-4242da4b8049 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:12.934474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4c41322e-a119-4f33-9760-f1db5d44f0f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:12.935687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-905717e7-382b-4217-bffc-4242da4b8049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:12.944917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1033/2094] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:12.945770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905717e7-382b-4217-bffc-4242da4b8049 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:12.957682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905717e7-382b-4217-bffc-4242da4b8049 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:12.962899 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f7bd2-44a9-4779-8708-7a5200a60f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:12.963653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7bd2-44a9-4779-8708-7a5200a60f55 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:12.964000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7bd2-44a9-4779-8708-7a5200a60f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:12.964342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f7bd2-44a9-4779-8708-7a5200a60f55 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:12.965193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f7bd2-44a9-4779-8708-7a5200a60f55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:38:12.965599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f7bd2-44a9-4779-8708-7a5200a60f55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:12.976174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f7bd2-44a9-4779-8708-7a5200a60f55 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:12.979955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1034/2095] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:38:12.981577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e6e66-86de-4733-b384-108d1fc182d8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:12.981862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e6e66-86de-4733-b384-108d1fc182d8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:12.982137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4e6e66-86de-4733-b384-108d1fc182d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:12.996037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c41322e-a119-4f33-9760-f1db5d44f0f7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:12.999706 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112caac5-95b9-4418-80f3-75651cb0480e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:12.999922 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0e4e6e66-86de-4733-b384-108d1fc182d8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:13.000380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112caac5-95b9-4418-80f3-75651cb0480e service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.000711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112caac5-95b9-4418-80f3-75651cb0480e service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.004129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112caac5-95b9-4418-80f3-75651cb0480e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.004248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0e4e6e66-86de-4733-b384-108d1fc182d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:13.009955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1035/2096] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:13.010532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e6e66-86de-4733-b384-108d1fc182d8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.013881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112caac5-95b9-4418-80f3-75651cb0480e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.015437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112caac5-95b9-4418-80f3-75651cb0480e service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.020540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4e6e66-86de-4733-b384-108d1fc182d8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.026500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1ce3f-9e7e-48de-b046-876537acfcf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.027352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1ce3f-9e7e-48de-b046-876537acfcf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.028067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1062/2097] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:13.029112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112caac5-95b9-4418-80f3-75651cb0480e service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.033093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1ce3f-9e7e-48de-b046-876537acfcf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.033246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af1ce3f-9e7e-48de-b046-876537acfcf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.034551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1ce3f-9e7e-48de-b046-876537acfcf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.036569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af1ce3f-9e7e-48de-b046-876537acfcf7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.042214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112caac5-95b9-4418-80f3-75651cb0480e service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.056529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c6c8a-db45-4039-befc-809f31845166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.056921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c6c8a-db45-4039-befc-809f31845166 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.057213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c6c8a-db45-4039-befc-809f31845166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.057492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3c6c8a-db45-4039-befc-809f31845166 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.058855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c6c8a-db45-4039-befc-809f31845166 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:38:13.059895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c6c8a-db45-4039-befc-809f31845166 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.062344 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3c6c8a-db45-4039-befc-809f31845166 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.077629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1063/2098] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:38:13.085603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c6c8a-db45-4039-befc-809f31845166 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.095947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3c6c8a-db45-4039-befc-809f31845166 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.101734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193424-3b64-444f-8348-fae7301fb8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.102415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193424-3b64-444f-8348-fae7301fb8de admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.103556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193424-3b64-444f-8348-fae7301fb8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.103846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1193424-3b64-444f-8348-fae7301fb8de admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.116037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1193424-3b64-444f-8348-fae7301fb8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.116037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1193424-3b64-444f-8348-fae7301fb8de admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.145052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1036/2099] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:13 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:13.149107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1ce3f-9e7e-48de-b046-876537acfcf7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.192405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:13.211759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1064/2100] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:13 2022] POST /identity/v3/projects => generated 385 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:13.213918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193424-3b64-444f-8348-fae7301fb8de admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.223096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af1ce3f-9e7e-48de-b046-876537acfcf7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.277258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1193424-3b64-444f-8348-fae7301fb8de admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.277791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be36b18-04a4-4f22-a97c-84e4216e611e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.278470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be36b18-04a4-4f22-a97c-84e4216e611e admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.278755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be36b18-04a4-4f22-a97c-84e4216e611e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.279034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be36b18-04a4-4f22-a97c-84e4216e611e admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.279768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be36b18-04a4-4f22-a97c-84e4216e611e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.281737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be36b18-04a4-4f22-a97c-84e4216e611e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.281945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94871318-5eb6-4901-8c2e-5c059cf04258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.282695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94871318-5eb6-4901-8c2e-5c059cf04258 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.282899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94871318-5eb6-4901-8c2e-5c059cf04258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.283175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94871318-5eb6-4901-8c2e-5c059cf04258 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.284555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94871318-5eb6-4901-8c2e-5c059cf04258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.286578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94871318-5eb6-4901-8c2e-5c059cf04258 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.390865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1065/2101] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:13 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:38:13.391023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1037/2102] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:13 2022] POST /identity/v3/users => generated 282 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:38:13.392437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94871318-5eb6-4901-8c2e-5c059cf04258 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.394333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be36b18-04a4-4f22-a97c-84e4216e611e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.405298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94871318-5eb6-4901-8c2e-5c059cf04258 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.411808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea5c16-5fe4-4fa8-ba3b-90c3e97b1f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.412722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea5c16-5fe4-4fa8-ba3b-90c3e97b1f6e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.413183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea5c16-5fe4-4fa8-ba3b-90c3e97b1f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.413463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea5c16-5fe4-4fa8-ba3b-90c3e97b1f6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.414192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea5c16-5fe4-4fa8-ba3b-90c3e97b1f6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.415985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea5c16-5fe4-4fa8-ba3b-90c3e97b1f6e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.419780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be36b18-04a4-4f22-a97c-84e4216e611e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.425414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84381b12-6a8b-48ca-9af7-a82192a31639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.426641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84381b12-6a8b-48ca-9af7-a82192a31639 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.426641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84381b12-6a8b-48ca-9af7-a82192a31639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.427407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1066/2103] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:13.428392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea5c16-5fe4-4fa8-ba3b-90c3e97b1f6e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.430225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84381b12-6a8b-48ca-9af7-a82192a31639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.432002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84381b12-6a8b-48ca-9af7-a82192a31639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.434111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84381b12-6a8b-48ca-9af7-a82192a31639 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.441289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dcea5c16-5fe4-4fa8-ba3b-90c3e97b1f6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:13.447911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1038/2104] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:13.449578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84381b12-6a8b-48ca-9af7-a82192a31639 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.462801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84381b12-6a8b-48ca-9af7-a82192a31639 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.467832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd15d41-b868-49b8-aa4a-f871b1f7b45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.468667 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd15d41-b868-49b8-aa4a-f871b1f7b45f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.469054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd15d41-b868-49b8-aa4a-f871b1f7b45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.469433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd15d41-b868-49b8-aa4a-f871b1f7b45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.470274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd15d41-b868-49b8-aa4a-f871b1f7b45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.472432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd15d41-b868-49b8-aa4a-f871b1f7b45f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.484867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1039/2105] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:13.486294 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd15d41-b868-49b8-aa4a-f871b1f7b45f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.489901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea5c16-5fe4-4fa8-ba3b-90c3e97b1f6e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.495422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.496428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.496819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.497315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] PATH_INFO: `/v3/users/28865c0adc1d496182eb223d818d304d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.498620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28865c0adc1d496182eb223d818d304d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.500694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.503895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=2,keystone:SELECT=93,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:13.510499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd15d41-b868-49b8-aa4a-f871b1f7b45f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.515889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe710f-36d2-477f-ba04-890e5c27d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.518885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe710f-36d2-477f-ba04-890e5c27d16d admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.518885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe710f-36d2-477f-ba04-890e5c27d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.518885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe710f-36d2-477f-ba04-890e5c27d16d admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.518885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe710f-36d2-477f-ba04-890e5c27d16d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.520402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe710f-36d2-477f-ba04-890e5c27d16d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.533689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1040/2106] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:13.533689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe710f-36d2-477f-ba04-890e5c27d16d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.542210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe710f-36d2-477f-ba04-890e5c27d16d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.548143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5f5f-8d30-442d-a3c1-63889ea0e684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.549063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5f5f-8d30-442d-a3c1-63889ea0e684 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.549364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5f5f-8d30-442d-a3c1-63889ea0e684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.549676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f5f5f-8d30-442d-a3c1-63889ea0e684 admin admin] PATH_INFO: `/v3/projects/3d3e20e83abc4cdba38e42a1aba8e509/users/827fb9e02daa4469bc48dcf58caef1c1/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.567965 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f5f5f-8d30-442d-a3c1-63889ea0e684 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d3e20e83abc4cdba38e42a1aba8e509, user_id=827fb9e02daa4469bc48dcf58caef1c1, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.570742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f5f5f-8d30-442d-a3c1-63889ea0e684 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.630761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1041/2107] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:13 2022] PUT /identity/v3/projects/3d3e20e83abc4cdba38e42a1aba8e509/users/827fb9e02daa4469bc48dcf58caef1c1/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:13.631979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5f5f-8d30-442d-a3c1-63889ea0e684 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.694242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f5f5f-8d30-442d-a3c1-63889ea0e684 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.699401 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd62497-4837-4fb3-8155-d26d7052f278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.700335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62497-4837-4fb3-8155-d26d7052f278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.700648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62497-4837-4fb3-8155-d26d7052f278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.700927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd62497-4837-4fb3-8155-d26d7052f278 admin admin] PATH_INFO: `/v3/projects/6ce1c23537f5469d84f896661937d823/users/08e3c1c326b34cdbb6cd63cc6a2ea488/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.704226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28865c0adc1d496182eb223d818d304d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:13.715924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd62497-4837-4fb3-8155-d26d7052f278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ce1c23537f5469d84f896661937d823, user_id=08e3c1c326b34cdbb6cd63cc6a2ea488, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.718073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28865c0adc1d496182eb223d818d304d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:13.718677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd62497-4837-4fb3-8155-d26d7052f278 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:13.833311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28865c0adc1d496182eb223d818d304d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:13.833985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28865c0adc1d496182eb223d818d304d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:13.834608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-2fa590cd-cec0-4e51-9c70-4c24f14845d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28865c0adc1d496182eb223d818d304d'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:13.839531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1042/2108] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:13 2022] PUT /identity/v3/projects/6ce1c23537f5469d84f896661937d823/users/08e3c1c326b34cdbb6cd63cc6a2ea488/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:13.840763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd62497-4837-4fb3-8155-d26d7052f278 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:13.842562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fbd62497-4837-4fb3-8155-d26d7052f278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:13.847697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1067/2109] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:13 2022] DELETE /identity/v3/users/28865c0adc1d496182eb223d818d304d => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:13.849559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c796020-ec80-4c8d-8a25-c8241d82c842 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.849856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c796020-ec80-4c8d-8a25-c8241d82c842 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.850135 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c796020-ec80-4c8d-8a25-c8241d82c842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.877291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5c796020-ec80-4c8d-8a25-c8241d82c842 None None] MFA Rules not processed for user `827fb9e02daa4469bc48dcf58caef1c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:13.879301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5c796020-ec80-4c8d-8a25-c8241d82c842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:13.910931 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd62497-4837-4fb3-8155-d26d7052f278 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:13.942676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1068/2110] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:13 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:13.944037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b322536-a33e-4483-ae55-71406a27f22c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.944513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b322536-a33e-4483-ae55-71406a27f22c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.944696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b322536-a33e-4483-ae55-71406a27f22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.967885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:13.968955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:13.969263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:13.969537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] PATH_INFO: `/v3/projects/5f6d68dc053f4a8fba7ea018169eb071` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:13.969657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0b322536-a33e-4483-ae55-71406a27f22c None None] MFA Rules not processed for user `08e3c1c326b34cdbb6cd63cc6a2ea488`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:13.970726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0b322536-a33e-4483-ae55-71406a27f22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:13.970833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f6d68dc053f4a8fba7ea018169eb071)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:13.972915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.039755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1069/2111] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:13 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:14.039755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2333b-4ab9-4876-a1ec-0be44a386459 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.039755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2333b-4ab9-4876-a1ec-0be44a386459 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.039755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb2333b-4ab9-4876-a1ec-0be44a386459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.063857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ccb2333b-4ab9-4876-a1ec-0be44a386459 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:14.065997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ccb2333b-4ab9-4876-a1ec-0be44a386459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.073878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1070/2112] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:14.074624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2333b-4ab9-4876-a1ec-0be44a386459 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.075847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ccb2333b-4ab9-4876-a1ec-0be44a386459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.087361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb2333b-4ab9-4876-a1ec-0be44a386459 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.092009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec275883-bc69-417e-ab95-99e64e327b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.094030 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec275883-bc69-417e-ab95-99e64e327b0f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.094030 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec275883-bc69-417e-ab95-99e64e327b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.094030 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec275883-bc69-417e-ab95-99e64e327b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.094469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec275883-bc69-417e-ab95-99e64e327b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.097046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec275883-bc69-417e-ab95-99e64e327b0f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.136538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f6d68dc053f4a8fba7ea018169eb071', 'request_id': 'req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:14.142756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f6d68dc053f4a8fba7ea018169eb071', 'request_id': 'req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:14.148736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:14.150721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f6d68dc053f4a8fba7ea018169eb071', 'request_id': 'req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:14.200947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1071/2113] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:14 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:14.201751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec275883-bc69-417e-ab95-99e64e327b0f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.203301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ec275883-bc69-417e-ab95-99e64e327b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.222268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] The token cache is being invalidate because project 5f6d68dc053f4a8fba7ea018169eb071 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:14.222558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:14.223215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:14.224837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1043/2114] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:13 2022] DELETE /identity/v3/projects/5f6d68dc053f4a8fba7ea018169eb071 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:14.225757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.227060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.276110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec275883-bc69-417e-ab95-99e64e327b0f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.281714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013d30d-17a6-427e-bd81-dc5d944bca21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.282375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013d30d-17a6-427e-bd81-dc5d944bca21 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.282658 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013d30d-17a6-427e-bd81-dc5d944bca21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.282931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013d30d-17a6-427e-bd81-dc5d944bca21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.283768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013d30d-17a6-427e-bd81-dc5d944bca21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.286147 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013d30d-17a6-427e-bd81-dc5d944bca21 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.290293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3ca7ae-f93e-461d-b3db-41c2d7c9cee2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.343046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce480c0-3ce8-4156-aa40-4088bc8c2ed7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.343721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce480c0-3ce8-4156-aa40-4088bc8c2ed7 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.344004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce480c0-3ce8-4156-aa40-4088bc8c2ed7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.344280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce480c0-3ce8-4156-aa40-4088bc8c2ed7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.346192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3ce480c0-3ce8-4156-aa40-4088bc8c2ed7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.358760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce480c0-3ce8-4156-aa40-4088bc8c2ed7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.360197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce480c0-3ce8-4156-aa40-4088bc8c2ed7 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.366843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1072/2115] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:14 2022] POST /identity/v3/projects => generated 363 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:14.367494 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013d30d-17a6-427e-bd81-dc5d944bca21 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.373901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1044/2116] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:14.375262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd938c7-a2a8-41da-b808-d5cbdc909b34 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.375553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd938c7-a2a8-41da-b808-d5cbdc909b34 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.375926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd938c7-a2a8-41da-b808-d5cbdc909b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.379139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3013d30d-17a6-427e-bd81-dc5d944bca21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.416637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-edd938c7-a2a8-41da-b808-d5cbdc909b34 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:14.418002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-edd938c7-a2a8-41da-b808-d5cbdc909b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.450010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013d30d-17a6-427e-bd81-dc5d944bca21 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.455460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d81fb23-5e96-4405-9557-360349781343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.456945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81fb23-5e96-4405-9557-360349781343 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.457603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81fb23-5e96-4405-9557-360349781343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.458025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d81fb23-5e96-4405-9557-360349781343 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.458843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81fb23-5e96-4405-9557-360349781343 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.460845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d81fb23-5e96-4405-9557-360349781343 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.490609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1045/2117] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:14.491468 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd938c7-a2a8-41da-b808-d5cbdc909b34 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.492753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-edd938c7-a2a8-41da-b808-d5cbdc909b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.504797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd938c7-a2a8-41da-b808-d5cbdc909b34 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.509639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e577cc-832b-4cfe-98f3-609184e25eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.510303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e577cc-832b-4cfe-98f3-609184e25eb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.510590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e577cc-832b-4cfe-98f3-609184e25eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.510870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e577cc-832b-4cfe-98f3-609184e25eb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.511572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e577cc-832b-4cfe-98f3-609184e25eb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.513050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:14.513606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e577cc-832b-4cfe-98f3-609184e25eb6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.558722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1073/2118] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:14 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:14.559999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df928-c9fa-41f6-9bda-9a901d248bcb None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.560293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df928-c9fa-41f6-9bda-9a901d248bcb None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.560585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9df928-c9fa-41f6-9bda-9a901d248bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.579604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8e9df928-c9fa-41f6-9bda-9a901d248bcb None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:14.580865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8e9df928-c9fa-41f6-9bda-9a901d248bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.599754 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1074/2119] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:14.600559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9df928-c9fa-41f6-9bda-9a901d248bcb None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.614489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9df928-c9fa-41f6-9bda-9a901d248bcb None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.619129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b5d96-c130-460e-ab94-2fd7a6819d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.620025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b5d96-c130-460e-ab94-2fd7a6819d64 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.620235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b5d96-c130-460e-ab94-2fd7a6819d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.620536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b5d96-c130-460e-ab94-2fd7a6819d64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.621259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b5d96-c130-460e-ab94-2fd7a6819d64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.622875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b5d96-c130-460e-ab94-2fd7a6819d64 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.636420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1075/2120] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:14.636420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b5d96-c130-460e-ab94-2fd7a6819d64 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.644402 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b5d96-c130-460e-ab94-2fd7a6819d64 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.649009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5e638-cf14-4570-9af3-fb932a22f54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.649678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e638-cf14-4570-9af3-fb932a22f54a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.650143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e638-cf14-4570-9af3-fb932a22f54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.650427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5e638-cf14-4570-9af3-fb932a22f54a admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.651532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5e638-cf14-4570-9af3-fb932a22f54a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:38:14.651840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5e638-cf14-4570-9af3-fb932a22f54a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.653465 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a5e638-cf14-4570-9af3-fb932a22f54a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.664030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:14.667727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1076/2121] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:38:14.669337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1046/2122] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:14 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:14.670288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5e638-cf14-4570-9af3-fb932a22f54a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.676998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e577cc-832b-4cfe-98f3-609184e25eb6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.682780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5e638-cf14-4570-9af3-fb932a22f54a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.689231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930a647-5901-453a-b271-c7028176806f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.689909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930a647-5901-453a-b271-c7028176806f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.690797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930a647-5901-453a-b271-c7028176806f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.691074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8930a647-5901-453a-b271-c7028176806f admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.691919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930a647-5901-453a-b271-c7028176806f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.693576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8930a647-5901-453a-b271-c7028176806f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.694804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e577cc-832b-4cfe-98f3-609184e25eb6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.702687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daba9d-c777-4b75-b5b7-28bcefa2ffb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.703460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daba9d-c777-4b75-b5b7-28bcefa2ffb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.703842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daba9d-c777-4b75-b5b7-28bcefa2ffb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.704219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60daba9d-c777-4b75-b5b7-28bcefa2ffb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.705069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daba9d-c777-4b75-b5b7-28bcefa2ffb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.707369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60daba9d-c777-4b75-b5b7-28bcefa2ffb6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.713339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1077/2123] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:14.713339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930a647-5901-453a-b271-c7028176806f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.720828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8930a647-5901-453a-b271-c7028176806f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.727099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d976-ee70-492c-b10c-91ba1ac1e5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.727764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d976-ee70-492c-b10c-91ba1ac1e5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.728045 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d976-ee70-492c-b10c-91ba1ac1e5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.728321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d976-ee70-492c-b10c-91ba1ac1e5d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.729127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501d976-ee70-492c-b10c-91ba1ac1e5d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.730994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501d976-ee70-492c-b10c-91ba1ac1e5d7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.741593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1078/2124] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:14.742363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d976-ee70-492c-b10c-91ba1ac1e5d7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.754674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d976-ee70-492c-b10c-91ba1ac1e5d7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.759301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054cae-a090-4931-b43e-2fd9fe050691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.760201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054cae-a090-4931-b43e-2fd9fe050691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.760506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054cae-a090-4931-b43e-2fd9fe050691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.760789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93054cae-a090-4931-b43e-2fd9fe050691 admin admin] PATH_INFO: `/v3/projects/e313e9fc18114c02b6ecd81968e8c30e/users/b073b1322864493ca6e413fa6c8681b3/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.775422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93054cae-a090-4931-b43e-2fd9fe050691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e313e9fc18114c02b6ecd81968e8c30e, user_id=b073b1322864493ca6e413fa6c8681b3, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.778117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93054cae-a090-4931-b43e-2fd9fe050691 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.872591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1047/2125] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:14 2022] POST /identity/v3/projects => generated 397 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:14.872591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daba9d-c777-4b75-b5b7-28bcefa2ffb6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.901210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1079/2126] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:14 2022] PUT /identity/v3/projects/e313e9fc18114c02b6ecd81968e8c30e/users/b073b1322864493ca6e413fa6c8681b3/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:14.901210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054cae-a090-4931-b43e-2fd9fe050691 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:14.903054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-93054cae-a090-4931-b43e-2fd9fe050691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:14.946794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60daba9d-c777-4b75-b5b7-28bcefa2ffb6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.965764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:14.970821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93054cae-a090-4931-b43e-2fd9fe050691 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:14.976521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:14.978689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:14.978972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:14.979245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] PATH_INFO: `/v3/projects/7605f4d77c824db5aab82cc339d21482` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:14.980437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7605f4d77c824db5aab82cc339d21482)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:14.982774 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:14.999063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:15.007640 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26712e-5e09-4ebf-8381-3e1b965e1edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.008587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26712e-5e09-4ebf-8381-3e1b965e1edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.012892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26712e-5e09-4ebf-8381-3e1b965e1edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.012892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de26712e-5e09-4ebf-8381-3e1b965e1edd admin admin] PATH_INFO: `/v3/projects/c587bf972e684cc8864bbe44eacd5040/users/d59431489a114e1581a950c3cd1c5a1e/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.024197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26712e-5e09-4ebf-8381-3e1b965e1edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c587bf972e684cc8864bbe44eacd5040, user_id=d59431489a114e1581a950c3cd1c5a1e, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.026980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de26712e-5e09-4ebf-8381-3e1b965e1edd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.160168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1048/2127] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:14 2022] PUT /identity/v3/projects/c587bf972e684cc8864bbe44eacd5040/users/d59431489a114e1581a950c3cd1c5a1e/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:15.160953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26712e-5e09-4ebf-8381-3e1b965e1edd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.167931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7605f4d77c824db5aab82cc339d21482', 'request_id': 'req-74190fa3-34d6-425e-be13-0b0b43b62095'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:15.174300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7605f4d77c824db5aab82cc339d21482', 'request_id': 'req-74190fa3-34d6-425e-be13-0b0b43b62095'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:15.179679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7605f4d77c824db5aab82cc339d21482', 'request_id': 'req-74190fa3-34d6-425e-be13-0b0b43b62095'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:15.222456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de26712e-5e09-4ebf-8381-3e1b965e1edd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.250088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] The token cache is being invalidate because project 7605f4d77c824db5aab82cc339d21482 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:15.250378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:15.251012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-74190fa3-34d6-425e-be13-0b0b43b62095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:15.253343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1080/2128] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:14 2022] DELETE /identity/v3/projects/7605f4d77c824db5aab82cc339d21482 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:15.257968 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6a3be-490b-45d1-bf80-8903de1afc46 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.258254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6a3be-490b-45d1-bf80-8903de1afc46 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.258532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6a3be-490b-45d1-bf80-8903de1afc46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.282821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f49350-cfc4-40c5-8552-920ecdbfd8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.283489 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f49350-cfc4-40c5-8552-920ecdbfd8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.283819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f49350-cfc4-40c5-8552-920ecdbfd8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.284099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f49350-cfc4-40c5-8552-920ecdbfd8a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.285003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f49350-cfc4-40c5-8552-920ecdbfd8a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.286959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-76a6a3be-490b-45d1-bf80-8903de1afc46 None None] MFA Rules not processed for user `b073b1322864493ca6e413fa6c8681b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:15.288204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-76a6a3be-490b-45d1-bf80-8903de1afc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:15.292199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f49350-cfc4-40c5-8552-920ecdbfd8a3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.303067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:15.333456 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:15.355168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1081/2129] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:15.356225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6a3be-490b-45d1-bf80-8903de1afc46 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.357593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-76a6a3be-490b-45d1-bf80-8903de1afc46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:15.371363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a6a3be-490b-45d1-bf80-8903de1afc46 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.376128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51210b2e-723a-4204-919e-c92ab95de1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.376885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51210b2e-723a-4204-919e-c92ab95de1af admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.377194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51210b2e-723a-4204-919e-c92ab95de1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.377489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51210b2e-723a-4204-919e-c92ab95de1af admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.379076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51210b2e-723a-4204-919e-c92ab95de1af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.380838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51210b2e-723a-4204-919e-c92ab95de1af admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.390984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1049/2130] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:15 2022] POST /identity/v3/users => generated 299 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:15.390984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa3b61-1974-49e1-ae0f-f8f4d5e3be0f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.390984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa3b61-1974-49e1-ae0f-f8f4d5e3be0f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.390984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaa3b61-1974-49e1-ae0f-f8f4d5e3be0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.395511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1082/2131] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:15.396327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51210b2e-723a-4204-919e-c92ab95de1af admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.398327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-51210b2e-723a-4204-919e-c92ab95de1af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:15.411607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51210b2e-723a-4204-919e-c92ab95de1af admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.414324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-dfaa3b61-1974-49e1-ae0f-f8f4d5e3be0f None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:15.417263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d20bf-a2e8-4cb6-b8af-08ee55c36d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.417469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dfaa3b61-1974-49e1-ae0f-f8f4d5e3be0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:15.418062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d20bf-a2e8-4cb6-b8af-08ee55c36d98 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.418524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d20bf-a2e8-4cb6-b8af-08ee55c36d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.418852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d20bf-a2e8-4cb6-b8af-08ee55c36d98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.419618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d20bf-a2e8-4cb6-b8af-08ee55c36d98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.421837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d20bf-a2e8-4cb6-b8af-08ee55c36d98 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.428556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1050/2132] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:15.430054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa3b61-1974-49e1-ae0f-f8f4d5e3be0f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.436963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dfaa3b61-1974-49e1-ae0f-f8f4d5e3be0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:15.444228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaa3b61-1974-49e1-ae0f-f8f4d5e3be0f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.449135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbc2ac-26cd-43b8-9a54-a0e22849686d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.450100 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbc2ac-26cd-43b8-9a54-a0e22849686d admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.450448 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbc2ac-26cd-43b8-9a54-a0e22849686d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.455742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fbc2ac-26cd-43b8-9a54-a0e22849686d admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.455742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbc2ac-26cd-43b8-9a54-a0e22849686d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.455742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fbc2ac-26cd-43b8-9a54-a0e22849686d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.464773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1051/2133] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:15.465640 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbc2ac-26cd-43b8-9a54-a0e22849686d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.476416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fbc2ac-26cd-43b8-9a54-a0e22849686d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.481517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e60f96-42b9-41ed-b523-646e60f22270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.484583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60f96-42b9-41ed-b523-646e60f22270 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.484583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60f96-42b9-41ed-b523-646e60f22270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.484583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e60f96-42b9-41ed-b523-646e60f22270 admin admin] PATH_INFO: `/v3/projects/c587bf972e684cc8864bbe44eacd5040/users/d59431489a114e1581a950c3cd1c5a1e/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.485067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e60f96-42b9-41ed-b523-646e60f22270 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c587bf972e684cc8864bbe44eacd5040, user_id=d59431489a114e1581a950c3cd1c5a1e, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.488813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e60f96-42b9-41ed-b523-646e60f22270 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.500400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1052/2134] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:15 2022] PUT /identity/v3/projects/c587bf972e684cc8864bbe44eacd5040/users/d59431489a114e1581a950c3cd1c5a1e/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:15.501951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d3617-b120-4378-a4c6-b31b2f9c2881 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.502509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d3617-b120-4378-a4c6-b31b2f9c2881 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.503943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d3617-b120-4378-a4c6-b31b2f9c2881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.522606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-407d3617-b120-4378-a4c6-b31b2f9c2881 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:15.523799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-407d3617-b120-4378-a4c6-b31b2f9c2881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:15.541606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1083/2135] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:15 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:15.541606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d20bf-a2e8-4cb6-b8af-08ee55c36d98 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.607339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1053/2136] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:15.608866 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37723-5a6b-4bd9-b720-1bda7d236535 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.609151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37723-5a6b-4bd9-b720-1bda7d236535 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.609426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f37723-5a6b-4bd9-b720-1bda7d236535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.625062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d20bf-a2e8-4cb6-b8af-08ee55c36d98 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.630345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95284fea-1ffb-4a44-bcfe-2396e3304145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.631012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95284fea-1ffb-4a44-bcfe-2396e3304145 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.631296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95284fea-1ffb-4a44-bcfe-2396e3304145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.631647 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95284fea-1ffb-4a44-bcfe-2396e3304145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.632300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95284fea-1ffb-4a44-bcfe-2396e3304145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.634549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95284fea-1ffb-4a44-bcfe-2396e3304145 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.636762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-43f37723-5a6b-4bd9-b720-1bda7d236535 None None] MFA Rules not processed for user `d59431489a114e1581a950c3cd1c5a1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:15.638199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-43f37723-5a6b-4bd9-b720-1bda7d236535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:15.646048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1084/2137] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:15.646842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95284fea-1ffb-4a44-bcfe-2396e3304145 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.656913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95284fea-1ffb-4a44-bcfe-2396e3304145 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.662823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcae13a-21e1-4540-b28c-f33ba4c5f38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.663496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcae13a-21e1-4540-b28c-f33ba4c5f38e admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.663905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcae13a-21e1-4540-b28c-f33ba4c5f38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.664245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcae13a-21e1-4540-b28c-f33ba4c5f38e admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.665165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcae13a-21e1-4540-b28c-f33ba4c5f38e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.667204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcae13a-21e1-4540-b28c-f33ba4c5f38e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.715568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1054/2138] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:15 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:15.716525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37723-5a6b-4bd9-b720-1bda7d236535 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.727812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f37723-5a6b-4bd9-b720-1bda7d236535 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.732888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.733536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.733819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.734094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.734823 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:38:15.735135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.736758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.750680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1085/2139] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:15 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:15.750680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcae13a-21e1-4540-b28c-f33ba4c5f38e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.750979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1055/2140] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:38:15.750979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.751860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:15.759915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcae13a-21e1-4540-b28c-f33ba4c5f38e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.764975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d157-6365-401c-a3e9-6c8fcf75f977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.765994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d157-6365-401c-a3e9-6c8fcf75f977 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.766336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d157-6365-401c-a3e9-6c8fcf75f977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.766679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672d157-6365-401c-a3e9-6c8fcf75f977 admin admin] PATH_INFO: `/v3/projects/a680a35019b24f3cace00cc42b1f620e/users/4412b19087ed40eb8a81193bf33224d8/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.783353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d157-6365-401c-a3e9-6c8fcf75f977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a680a35019b24f3cace00cc42b1f620e, user_id=4412b19087ed40eb8a81193bf33224d8, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.787011 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672d157-6365-401c-a3e9-6c8fcf75f977 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.794761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:15.810299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f536037f-d128-4b35-b238-83c4c5cfc9d3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.813949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779fa9c-0f3c-4494-b893-9d94c253c467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.814590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779fa9c-0f3c-4494-b893-9d94c253c467 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.814873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779fa9c-0f3c-4494-b893-9d94c253c467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.815177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e779fa9c-0f3c-4494-b893-9d94c253c467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.824036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779fa9c-0f3c-4494-b893-9d94c253c467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.825493 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e779fa9c-0f3c-4494-b893-9d94c253c467 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.835414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1056/2141] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:15 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:15.836927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779fa9c-0f3c-4494-b893-9d94c253c467 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.847567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e779fa9c-0f3c-4494-b893-9d94c253c467 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.852087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36812745-af50-45e4-a3d2-35a2814a5dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.852770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812745-af50-45e4-a3d2-35a2814a5dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.853056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812745-af50-45e4-a3d2-35a2814a5dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.853338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36812745-af50-45e4-a3d2-35a2814a5dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.854054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812745-af50-45e4-a3d2-35a2814a5dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.855993 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36812745-af50-45e4-a3d2-35a2814a5dbb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.864085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1086/2142] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:15 2022] PUT /identity/v3/projects/a680a35019b24f3cace00cc42b1f620e/users/4412b19087ed40eb8a81193bf33224d8/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:15.865199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d157-6365-401c-a3e9-6c8fcf75f977 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.870173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1057/2143] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:15.874567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc8dde-0d0b-4362-877e-c36300b5541b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.874856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc8dde-0d0b-4362-877e-c36300b5541b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.875187 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc8dde-0d0b-4362-877e-c36300b5541b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.902231 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9adc8dde-0d0b-4362-877e-c36300b5541b None None] MFA Rules not processed for user `4412b19087ed40eb8a81193bf33224d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:15.904298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9adc8dde-0d0b-4362-877e-c36300b5541b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:15.931958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672d157-6365-401c-a3e9-6c8fcf75f977 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.937467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b133f-bc87-40ec-bbc6-7ec3853edbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.938203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b133f-bc87-40ec-bbc6-7ec3853edbce admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.938540 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b133f-bc87-40ec-bbc6-7ec3853edbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.938871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b133f-bc87-40ec-bbc6-7ec3853edbce admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:15.941612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b133f-bc87-40ec-bbc6-7ec3853edbce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:15.941732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24b133f-bc87-40ec-bbc6-7ec3853edbce admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:15.950113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:15.972241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1058/2144] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:38:15.976616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc8dde-0d0b-4362-877e-c36300b5541b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:15.984309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc8dde-0d0b-4362-877e-c36300b5541b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:15.990100 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784209-4e38-4bd3-b7c1-cd6527908535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:15.991017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784209-4e38-4bd3-b7c1-cd6527908535 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:15.991372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784209-4e38-4bd3-b7c1-cd6527908535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:15.991590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06784209-4e38-4bd3-b7c1-cd6527908535 admin admin] PATH_INFO: `/v3/projects/e15392907e0d493d88c2d25e134b0322/users/962581f9a6094d94864612c305794c09/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.008039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06784209-4e38-4bd3-b7c1-cd6527908535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15392907e0d493d88c2d25e134b0322, user_id=962581f9a6094d94864612c305794c09, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:16.016399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06784209-4e38-4bd3-b7c1-cd6527908535 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:16.041334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1087/2145] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:15 2022] POST /identity/v3/projects => generated 391 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:16.042243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b133f-bc87-40ec-bbc6-7ec3853edbce admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:16.044008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c24b133f-bc87-40ec-bbc6-7ec3853edbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:16.099862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b133f-bc87-40ec-bbc6-7ec3853edbce admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:16.103813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8b13-09db-43fa-be08-b5cc4a391aa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:16.104458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8b13-09db-43fa-be08-b5cc4a391aa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.106048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8b13-09db-43fa-be08-b5cc4a391aa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.106048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063d8b13-09db-43fa-be08-b5cc4a391aa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.108091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1059/2146] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:15 2022] PUT /identity/v3/projects/e15392907e0d493d88c2d25e134b0322/users/962581f9a6094d94864612c305794c09/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:16.111129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784209-4e38-4bd3-b7c1-cd6527908535 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:16.176329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d8b13-09db-43fa-be08-b5cc4a391aa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:16.177929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063d8b13-09db-43fa-be08-b5cc4a391aa4 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:16.179500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06784209-4e38-4bd3-b7c1-cd6527908535 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:16.186251 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3d75f-6e71-404a-8f00-13dc51f6d778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:16.186933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d75f-6e71-404a-8f00-13dc51f6d778 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.187217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d75f-6e71-404a-8f00-13dc51f6d778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.187499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3d75f-6e71-404a-8f00-13dc51f6d778 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.188211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3d75f-6e71-404a-8f00-13dc51f6d778 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:16.188987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1088/2147] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:16.189773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8b13-09db-43fa-be08-b5cc4a391aa4 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:16.190425 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3d75f-6e71-404a-8f00-13dc51f6d778 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:16.262622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063d8b13-09db-43fa-be08-b5cc4a391aa4 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:16.267307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56392b-0194-4568-9f33-b919b042c540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:16.268037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56392b-0194-4568-9f33-b919b042c540 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.268838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56392b-0194-4568-9f33-b919b042c540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.269113 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56392b-0194-4568-9f33-b919b042c540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.269845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56392b-0194-4568-9f33-b919b042c540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:16.271545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c56392b-0194-4568-9f33-b919b042c540 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:16.286484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1089/2148] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:16.286484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56392b-0194-4568-9f33-b919b042c540 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:16.288623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1060/2149] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:16 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:16.289600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3d75f-6e71-404a-8f00-13dc51f6d778 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:16.297913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56392b-0194-4568-9f33-b919b042c540 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:16.299988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3d75f-6e71-404a-8f00-13dc51f6d778 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:16.303044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12632909-ddd5-4391-8da0-1f5e4531a7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:16.303538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12632909-ddd5-4391-8da0-1f5e4531a7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.303825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12632909-ddd5-4391-8da0-1f5e4531a7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.304124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12632909-ddd5-4391-8da0-1f5e4531a7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.304873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12632909-ddd5-4391-8da0-1f5e4531a7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:16.306482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12632909-ddd5-4391-8da0-1f5e4531a7e1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:16.309036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddf70e6-d645-4f3c-991e-dd63e8694254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:16.309036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf70e6-d645-4f3c-991e-dd63e8694254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.309036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf70e6-d645-4f3c-991e-dd63e8694254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.309036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddf70e6-d645-4f3c-991e-dd63e8694254 admin admin] PATH_INFO: `/v3/projects/e15392907e0d493d88c2d25e134b0322/users/962581f9a6094d94864612c305794c09/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.312129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf70e6-d645-4f3c-991e-dd63e8694254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15392907e0d493d88c2d25e134b0322, user_id=962581f9a6094d94864612c305794c09, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:16.315051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddf70e6-d645-4f3c-991e-dd63e8694254 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:16.325058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1090/2150] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:38:16.331893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1061/2151] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:16 2022] PUT /identity/v3/projects/e15392907e0d493d88c2d25e134b0322/users/962581f9a6094d94864612c305794c09/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:16.337305 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12632909-ddd5-4391-8da0-1f5e4531a7e1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:16.348903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0691-a972-481e-b486-2d4e6cdf2b60 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.349282 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0691-a972-481e-b486-2d4e6cdf2b60 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.349616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec0691-a972-481e-b486-2d4e6cdf2b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.364042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12632909-ddd5-4391-8da0-1f5e4531a7e1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:16.371652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:16.379185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b2ec0691-a972-481e-b486-2d4e6cdf2b60 None None] MFA Rules not processed for user `962581f9a6094d94864612c305794c09`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:16.380362 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b2ec0691-a972-481e-b486-2d4e6cdf2b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:16.394991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:16.435289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2b819-ed77-48ae-bc42-a824161b460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:16.436403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2b819-ed77-48ae-bc42-a824161b460c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.436818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2b819-ed77-48ae-bc42-a824161b460c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.437144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2b819-ed77-48ae-bc42-a824161b460c admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.437834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2b819-ed77-48ae-bc42-a824161b460c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:16.439448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc2b819-ed77-48ae-bc42-a824161b460c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:16.452756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1091/2152] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:16.457489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2b819-ed77-48ae-bc42-a824161b460c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:16.467836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2b819-ed77-48ae-bc42-a824161b460c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:16.473165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1062/2153] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:38:16.473509 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586469-6695-4abf-a82f-88e7d9b2f18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:16.474585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586469-6695-4abf-a82f-88e7d9b2f18c admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.474928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586469-6695-4abf-a82f-88e7d9b2f18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.475271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81586469-6695-4abf-a82f-88e7d9b2f18c admin admin] PATH_INFO: `/v3/projects/c9b5acb33e7d43aebde8ddac9749eefe/users/11e8bfa0f286449d98af1d8135e42319/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.491533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81586469-6695-4abf-a82f-88e7d9b2f18c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b5acb33e7d43aebde8ddac9749eefe, user_id=11e8bfa0f286449d98af1d8135e42319, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:16.494324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81586469-6695-4abf-a82f-88e7d9b2f18c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:16.577120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1092/2154] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:16 2022] PUT /identity/v3/projects/c9b5acb33e7d43aebde8ddac9749eefe/users/11e8bfa0f286449d98af1d8135e42319/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:16.589043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ff7eb-05d7-4b06-be6f-85e7345438ca None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.589341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ff7eb-05d7-4b06-be6f-85e7345438ca None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.589618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5ff7eb-05d7-4b06-be6f-85e7345438ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.616614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586469-6695-4abf-a82f-88e7d9b2f18c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:16.624679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7a5ff7eb-05d7-4b06-be6f-85e7345438ca None None] MFA Rules not processed for user `11e8bfa0f286449d98af1d8135e42319`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:16.626034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7a5ff7eb-05d7-4b06-be6f-85e7345438ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:16.677034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81586469-6695-4abf-a82f-88e7d9b2f18c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:16.680975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686914b-6a00-4e29-91dd-be782605ef3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:16.681869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686914b-6a00-4e29-91dd-be782605ef3b service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:16.682147 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686914b-6a00-4e29-91dd-be782605ef3b service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:16.682424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686914b-6a00-4e29-91dd-be782605ef3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:16.684468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3686914b-6a00-4e29-91dd-be782605ef3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:16.702852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1063/2155] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:16.752359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686914b-6a00-4e29-91dd-be782605ef3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:16.755523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686914b-6a00-4e29-91dd-be782605ef3b service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:16.768880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1093/2156] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:17.108333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ff7eb-05d7-4b06-be6f-85e7345438ca None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:17.120502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5ff7eb-05d7-4b06-be6f-85e7345438ca None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:17.125073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631f8f43-75e5-4593-ac97-b9876e58c1ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:17.125842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8f43-75e5-4593-ac97-b9876e58c1ce service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:17.126224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8f43-75e5-4593-ac97-b9876e58c1ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:17.126699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f8f43-75e5-4593-ac97-b9876e58c1ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:17.136566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f8f43-75e5-4593-ac97-b9876e58c1ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:17.141512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631f8f43-75e5-4593-ac97-b9876e58c1ce service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:17.149138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1064/2157] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:17.851520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686914b-6a00-4e29-91dd-be782605ef3b service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:17.921634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:17.927463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686914b-6a00-4e29-91dd-be782605ef3b service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:17.933886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:17.934899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:17.942840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:17.942840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] PATH_INFO: `/v3/users/08e3c1c326b34cdbb6cd63cc6a2ea488` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:17.942840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e3c1c326b34cdbb6cd63cc6a2ea488)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:17.942840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:18.178328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e3c1c326b34cdbb6cd63cc6a2ea488'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:18.190466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e3c1c326b34cdbb6cd63cc6a2ea488'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:18.279346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e3c1c326b34cdbb6cd63cc6a2ea488'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:18.280461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e3c1c326b34cdbb6cd63cc6a2ea488'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:18.281085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e3c1c326b34cdbb6cd63cc6a2ea488'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:18.294704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1094/2158] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:17 2022] DELETE /identity/v3/users/08e3c1c326b34cdbb6cd63cc6a2ea488 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:18.299147 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32099c-3f7b-4714-8008-ac3e3cd19811 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:18.300335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32099c-3f7b-4714-8008-ac3e3cd19811 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:18.300659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32099c-3f7b-4714-8008-ac3e3cd19811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:18.319331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fe32099c-3f7b-4714-8008-ac3e3cd19811 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:18.320561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fe32099c-3f7b-4714-8008-ac3e3cd19811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:18.382532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1065/2159] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:38:18.391839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:18.393456 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:18.450109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcee606-2c97-4c36-aa90-4dc25e0330fb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:18.454068 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178d28b-ea97-45b0-a721-1c3a3185bd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:18.454723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d28b-ea97-45b0-a721-1c3a3185bd0e service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:18.455006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d28b-ea97-45b0-a721-1c3a3185bd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:18.455322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178d28b-ea97-45b0-a721-1c3a3185bd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:18.464889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178d28b-ea97-45b0-a721-1c3a3185bd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:18.466375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178d28b-ea97-45b0-a721-1c3a3185bd0e service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:18.476025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1095/2160] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:18.899138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32099c-3f7b-4714-8008-ac3e3cd19811 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:18.900832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fe32099c-3f7b-4714-8008-ac3e3cd19811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:18.914407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32099c-3f7b-4714-8008-ac3e3cd19811 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:18.919127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:18.920000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:18.920284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:18.920591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] PATH_INFO: `/v3/projects/6ce1c23537f5469d84f896661937d823` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:18.921796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ce1c23537f5469d84f896661937d823)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:18.923762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:18.934133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:19.069348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ce1c23537f5469d84f896661937d823', 'request_id': 'req-edba4970-7100-487b-9a10-e3a485b50048'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.075592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ce1c23537f5469d84f896661937d823', 'request_id': 'req-edba4970-7100-487b-9a10-e3a485b50048'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.081678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ce1c23537f5469d84f896661937d823', 'request_id': 'req-edba4970-7100-487b-9a10-e3a485b50048'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.201779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] The token cache is being invalidate because project 6ce1c23537f5469d84f896661937d823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:19.202075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.205056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.211005 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1066/2161] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:18 2022] DELETE /identity/v3/projects/6ce1c23537f5469d84f896661937d823 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:19.211973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178d28b-ea97-45b0-a721-1c3a3185bd0e service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:19.225103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178d28b-ea97-45b0-a721-1c3a3185bd0e service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:19.258620 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:19.260006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:19.284762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:19.285731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:19.286076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:19.286415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] PATH_INFO: `/v3/users/d59431489a114e1581a950c3cd1c5a1e` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:19.290848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d59431489a114e1581a950c3cd1c5a1e)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:19.290848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:19.310761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:19.319082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edba4970-7100-487b-9a10-e3a485b50048 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:19.322897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:19.323488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:19.323768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:19.324046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:19.326009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:19.387197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:19.388662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:19.398238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1067/2162] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:38:19.505531 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd59431489a114e1581a950c3cd1c5a1e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.518986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd59431489a114e1581a950c3cd1c5a1e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.588580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd59431489a114e1581a950c3cd1c5a1e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.589331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd59431489a114e1581a950c3cd1c5a1e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.590103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-14c782ed-2ed9-402d-ba85-6f9d6f2f094c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd59431489a114e1581a950c3cd1c5a1e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:19.606700 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1096/2163] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:19 2022] DELETE /identity/v3/users/d59431489a114e1581a950c3cd1c5a1e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:20.075117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:20.076735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:20.102815 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2c490-9793-46d3-a49a-6b7b8db9ae81 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:20.157924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:20.168525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:20.169489 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:20.169692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:20.169971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] PATH_INFO: `/v3/projects/c587bf972e684cc8864bbe44eacd5040` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:20.171338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c587bf972e684cc8864bbe44eacd5040)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:20.173280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:20.268807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c587bf972e684cc8864bbe44eacd5040', 'request_id': 'req-f67d3499-0193-4e3d-bfca-5032b99dff69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:20.275042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c587bf972e684cc8864bbe44eacd5040', 'request_id': 'req-f67d3499-0193-4e3d-bfca-5032b99dff69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:20.280424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c587bf972e684cc8864bbe44eacd5040', 'request_id': 'req-f67d3499-0193-4e3d-bfca-5032b99dff69'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:20.392456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] The token cache is being invalidate because project c587bf972e684cc8864bbe44eacd5040 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:20.393112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:20.393363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f67d3499-0193-4e3d-bfca-5032b99dff69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:20.394907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1068/2164] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:20 2022] DELETE /identity/v3/projects/c587bf972e684cc8864bbe44eacd5040 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:20.400997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4a726-0fd1-4d86-a9c9-07da1ce4cefc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:20.401448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4a726-0fd1-4d86-a9c9-07da1ce4cefc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:20.401557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4a726-0fd1-4d86-a9c9-07da1ce4cefc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:20.420445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-29c4a726-0fd1-4d86-a9c9-07da1ce4cefc None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:20.421768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-29c4a726-0fd1-4d86-a9c9-07da1ce4cefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:20.481569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1097/2165] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:20.490123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7d6e-84e0-46ae-b8d0-5a4b39f57c4c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:20.490414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7d6e-84e0-46ae-b8d0-5a4b39f57c4c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:20.490693 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc7d6e-84e0-46ae-b8d0-5a4b39f57c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:20.508727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a1bc7d6e-84e0-46ae-b8d0-5a4b39f57c4c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:20.509990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a1bc7d6e-84e0-46ae-b8d0-5a4b39f57c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:20.517839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1069/2166] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:20.522111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4a726-0fd1-4d86-a9c9-07da1ce4cefc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:20.532026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4a726-0fd1-4d86-a9c9-07da1ce4cefc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:20.537075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1f6ee-3f88-4669-a6ec-fe96501035b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:20.537724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1f6ee-3f88-4669-a6ec-fe96501035b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:20.538006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1f6ee-3f88-4669-a6ec-fe96501035b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:20.538279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1f6ee-3f88-4669-a6ec-fe96501035b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:20.539005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1f6ee-3f88-4669-a6ec-fe96501035b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:38:20.539315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1f6ee-3f88-4669-a6ec-fe96501035b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:20.540950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1f6ee-3f88-4669-a6ec-fe96501035b2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:20.553218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1098/2167] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:38:20.557578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc7d6e-84e0-46ae-b8d0-5a4b39f57c4c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:20.568004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc7d6e-84e0-46ae-b8d0-5a4b39f57c4c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:20.572919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c280a6-8d75-4bf6-8687-0f32db3941ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:20.573651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c280a6-8d75-4bf6-8687-0f32db3941ab admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:20.573938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c280a6-8d75-4bf6-8687-0f32db3941ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:20.574212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c280a6-8d75-4bf6-8687-0f32db3941ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:20.574913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c280a6-8d75-4bf6-8687-0f32db3941ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:20.576850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c280a6-8d75-4bf6-8687-0f32db3941ab admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:20.692263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1070/2168] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:20 2022] POST /identity/v3/projects => generated 371 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:38:20.696227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1f6ee-3f88-4669-a6ec-fe96501035b2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:20.707245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1f6ee-3f88-4669-a6ec-fe96501035b2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:20.769033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886bf1c-1f98-4f77-b4a9-395e01f1b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:20.769804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886bf1c-1f98-4f77-b4a9-395e01f1b620 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:20.770147 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886bf1c-1f98-4f77-b4a9-395e01f1b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:20.770432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886bf1c-1f98-4f77-b4a9-395e01f1b620 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:20.771121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886bf1c-1f98-4f77-b4a9-395e01f1b620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:20.773197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886bf1c-1f98-4f77-b4a9-395e01f1b620 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:20.902946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1099/2169] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:20 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:20.908423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c280a6-8d75-4bf6-8687-0f32db3941ab admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:20.919197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c280a6-8d75-4bf6-8687-0f32db3941ab admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:20.923941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96539515-90d3-48ae-8e0e-b3a0ee0f9f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:20.925133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96539515-90d3-48ae-8e0e-b3a0ee0f9f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:20.925240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96539515-90d3-48ae-8e0e-b3a0ee0f9f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:20.925507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96539515-90d3-48ae-8e0e-b3a0ee0f9f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:20.926261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96539515-90d3-48ae-8e0e-b3a0ee0f9f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:20.927919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96539515-90d3-48ae-8e0e-b3a0ee0f9f09 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:20.939033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1071/2170] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:20.943551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886bf1c-1f98-4f77-b4a9-395e01f1b620 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:20.953609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886bf1c-1f98-4f77-b4a9-395e01f1b620 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:20.959878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94407456-8a3b-44a8-9dcc-8250e0e28f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:20.960572 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94407456-8a3b-44a8-9dcc-8250e0e28f82 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:20.960883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94407456-8a3b-44a8-9dcc-8250e0e28f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:20.961162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94407456-8a3b-44a8-9dcc-8250e0e28f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:20.963943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94407456-8a3b-44a8-9dcc-8250e0e28f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:20.963943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94407456-8a3b-44a8-9dcc-8250e0e28f82 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:20.977252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1100/2171] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:20.978446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96539515-90d3-48ae-8e0e-b3a0ee0f9f09 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:20.990444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96539515-90d3-48ae-8e0e-b3a0ee0f9f09 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:20.995329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd81d22-d581-42ae-9a80-dfa2de4a3228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:20.996243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd81d22-d581-42ae-9a80-dfa2de4a3228 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:20.996560 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd81d22-d581-42ae-9a80-dfa2de4a3228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:20.996865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd81d22-d581-42ae-9a80-dfa2de4a3228 admin admin] PATH_INFO: `/v3/projects/26533765b74640e9b40211155aaf41b6/users/ca77e354876a4fe1822541d900590b62/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:21.015078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd81d22-d581-42ae-9a80-dfa2de4a3228 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26533765b74640e9b40211155aaf41b6, user_id=ca77e354876a4fe1822541d900590b62, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:21.017802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd81d22-d581-42ae-9a80-dfa2de4a3228 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:21.096837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1072/2172] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:20 2022] PUT /identity/v3/projects/26533765b74640e9b40211155aaf41b6/users/ca77e354876a4fe1822541d900590b62/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:21.101912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dfa94-247f-40c6-856c-a32f106d6738 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:21.102227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dfa94-247f-40c6-856c-a32f106d6738 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:21.102508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0dfa94-247f-40c6-856c-a32f106d6738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:21.108613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:21.121323 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9d0dfa94-247f-40c6-856c-a32f106d6738 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:21.122506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9d0dfa94-247f-40c6-856c-a32f106d6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:21.184881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1101/2173] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:21.193963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd81d22-d581-42ae-9a80-dfa2de4a3228 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:21.196014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0fd81d22-d581-42ae-9a80-dfa2de4a3228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:21.253842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd81d22-d581-42ae-9a80-dfa2de4a3228 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:21.257566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab3d8af-1bba-4f99-ba9d-1993e1dc335d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:21.258213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3d8af-1bba-4f99-ba9d-1993e1dc335d service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:21.258498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3d8af-1bba-4f99-ba9d-1993e1dc335d service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:21.258775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab3d8af-1bba-4f99-ba9d-1993e1dc335d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:21.267628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3d8af-1bba-4f99-ba9d-1993e1dc335d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:21.269915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab3d8af-1bba-4f99-ba9d-1993e1dc335d service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:21.279235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1073/2174] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:22.165366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dfa94-247f-40c6-856c-a32f106d6738 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:22.166792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9d0dfa94-247f-40c6-856c-a32f106d6738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:22.226660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0dfa94-247f-40c6-856c-a32f106d6738 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:22.230417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dec7c-438a-4767-a870-32664d493c13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:22.231311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dec7c-438a-4767-a870-32664d493c13 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:22.231597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dec7c-438a-4767-a870-32664d493c13 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:22.231874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695dec7c-438a-4767-a870-32664d493c13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:22.233767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-695dec7c-438a-4767-a870-32664d493c13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:22.301407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dec7c-438a-4767-a870-32664d493c13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:22.302853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695dec7c-438a-4767-a870-32664d493c13 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:22.312539 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1102/2175] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:22.556423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9f3a-6197-45e4-902d-bd994dcd3ce3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:22.557374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9f3a-6197-45e4-902d-bd994dcd3ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:22.557929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf9f3a-6197-45e4-902d-bd994dcd3ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:22.608752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-baaf9f3a-6197-45e4-902d-bd994dcd3ce3 None None] MFA Rules not processed for user `ca77e354876a4fe1822541d900590b62`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:22.610142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-baaf9f3a-6197-45e4-902d-bd994dcd3ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:22.618566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:22.681127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1074/2176] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:22.685578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dec7c-438a-4767-a870-32664d493c13 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:22.696874 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695dec7c-438a-4767-a870-32664d493c13 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:22.701617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1022619-0765-40bf-952f-1af3915e7a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:22.702270 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1022619-0765-40bf-952f-1af3915e7a91 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:22.702550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1022619-0765-40bf-952f-1af3915e7a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:22.702822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1022619-0765-40bf-952f-1af3915e7a91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:22.703514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1022619-0765-40bf-952f-1af3915e7a91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:22.705463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1022619-0765-40bf-952f-1af3915e7a91 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:22.852126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1103/2177] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:22 2022] POST /identity/v3/projects => generated 371 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:22.856512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9f3a-6197-45e4-902d-bd994dcd3ce3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:22.867926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf9f3a-6197-45e4-902d-bd994dcd3ce3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:22.922293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f272a5-e7ac-4978-957e-09d3ab18fda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:22.923222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f272a5-e7ac-4978-957e-09d3ab18fda6 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:22.923502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f272a5-e7ac-4978-957e-09d3ab18fda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:22.923775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f272a5-e7ac-4978-957e-09d3ab18fda6 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:22.925026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f272a5-e7ac-4978-957e-09d3ab18fda6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:22.926982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f272a5-e7ac-4978-957e-09d3ab18fda6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:23.048466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1075/2178] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:22 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:38:23.054586 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1022619-0765-40bf-952f-1af3915e7a91 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:23.068611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1022619-0765-40bf-952f-1af3915e7a91 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:23.073929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ac23b-841e-489d-b857-8a214f93e5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:23.074770 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ac23b-841e-489d-b857-8a214f93e5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:23.075051 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ac23b-841e-489d-b857-8a214f93e5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:23.075711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ac23b-841e-489d-b857-8a214f93e5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:23.080249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ac23b-841e-489d-b857-8a214f93e5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:23.082193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ac23b-841e-489d-b857-8a214f93e5c5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:23.095146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1104/2179] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:23.098804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f272a5-e7ac-4978-957e-09d3ab18fda6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:23.109318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f272a5-e7ac-4978-957e-09d3ab18fda6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:23.115335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bfca9-025b-4cf5-b4d4-9ace11c20c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:23.116240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bfca9-025b-4cf5-b4d4-9ace11c20c9d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:23.117067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bfca9-025b-4cf5-b4d4-9ace11c20c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:23.117067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487bfca9-025b-4cf5-b4d4-9ace11c20c9d admin admin] PATH_INFO: `/v3/projects/fd4e4551b32b4fd081cc016c73715894/users/01e96d1332cd4940aa2b31109eaca2eb/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:23.157533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bfca9-025b-4cf5-b4d4-9ace11c20c9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4e4551b32b4fd081cc016c73715894, user_id=01e96d1332cd4940aa2b31109eaca2eb, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:23.161165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487bfca9-025b-4cf5-b4d4-9ace11c20c9d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:23.411553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1076/2180] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:23 2022] PUT /identity/v3/projects/fd4e4551b32b4fd081cc016c73715894/users/01e96d1332cd4940aa2b31109eaca2eb/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:23.415366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ac23b-841e-489d-b857-8a214f93e5c5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:23.426605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ac23b-841e-489d-b857-8a214f93e5c5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:23.443207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:23.483201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa39f2-c9dc-4415-9af1-7980751a42c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:23.483908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa39f2-c9dc-4415-9af1-7980751a42c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:23.484194 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa39f2-c9dc-4415-9af1-7980751a42c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:23.484485 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa39f2-c9dc-4415-9af1-7980751a42c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:23.485232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa39f2-c9dc-4415-9af1-7980751a42c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:23.486840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa39f2-c9dc-4415-9af1-7980751a42c0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:23.497108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1105/2181] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:23.501318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bfca9-025b-4cf5-b4d4-9ace11c20c9d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:23.511665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487bfca9-025b-4cf5-b4d4-9ace11c20c9d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:23.516220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07dd85-8468-4848-a8d0-68868044c2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:23.517132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07dd85-8468-4848-a8d0-68868044c2a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:23.517412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07dd85-8468-4848-a8d0-68868044c2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:23.517681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b07dd85-8468-4848-a8d0-68868044c2a1 admin admin] PATH_INFO: `/v3/projects/fd4e4551b32b4fd081cc016c73715894/users/01e96d1332cd4940aa2b31109eaca2eb/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:23.519812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07dd85-8468-4848-a8d0-68868044c2a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd4e4551b32b4fd081cc016c73715894, user_id=01e96d1332cd4940aa2b31109eaca2eb, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:23.522483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b07dd85-8468-4848-a8d0-68868044c2a1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:23.532501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1077/2182] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:23 2022] PUT /identity/v3/projects/fd4e4551b32b4fd081cc016c73715894/users/01e96d1332cd4940aa2b31109eaca2eb/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:24.909535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b1b8b-0873-445d-bba4-07c73cac2f5d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:24.910148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b1b8b-0873-445d-bba4-07c73cac2f5d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:24.910148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b1b8b-0873-445d-bba4-07c73cac2f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:24.937838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0f8b1b8b-0873-445d-bba4-07c73cac2f5d None None] MFA Rules not processed for user `01e96d1332cd4940aa2b31109eaca2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:24.939141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0f8b1b8b-0873-445d-bba4-07c73cac2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:25.043712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1106/2183] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:24 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:25.098702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07dd85-8468-4848-a8d0-68868044c2a1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:25.101139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0b07dd85-8468-4848-a8d0-68868044c2a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:25.176127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b07dd85-8468-4848-a8d0-68868044c2a1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:25.179722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b96262-79c1-41d9-9afa-447faf91f220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:25.184782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96262-79c1-41d9-9afa-447faf91f220 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:25.185098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96262-79c1-41d9-9afa-447faf91f220 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:25.185627 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b96262-79c1-41d9-9afa-447faf91f220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:25.201214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:25.255653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96262-79c1-41d9-9afa-447faf91f220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:25.257134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b96262-79c1-41d9-9afa-447faf91f220 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:25.266193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1078/2184] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:27.942922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b1b8b-0873-445d-bba4-07c73cac2f5d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:27.952298 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b1b8b-0873-445d-bba4-07c73cac2f5d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:27.964733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c53af-6845-4244-822e-8b4a2ed5e98a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:27.965390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c53af-6845-4244-822e-8b4a2ed5e98a service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:27.965698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c53af-6845-4244-822e-8b4a2ed5e98a service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:27.965972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c53af-6845-4244-822e-8b4a2ed5e98a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:27.975283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c53af-6845-4244-822e-8b4a2ed5e98a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:27.976844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c53af-6845-4244-822e-8b4a2ed5e98a service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:27.986847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1107/2185] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:27 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:31.153876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a01c4-7d9f-498d-a82b-bf13b86e905f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:31.154416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a01c4-7d9f-498d-a82b-bf13b86e905f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:31.154510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a01c4-7d9f-498d-a82b-bf13b86e905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:31.172729 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6e8a01c4-7d9f-498d-a82b-bf13b86e905f None None] MFA Rules not processed for user `f90f0f6afda54e80bc319dc5bdb80ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:31.173925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6e8a01c4-7d9f-498d-a82b-bf13b86e905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:31.235097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1079/2186] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:31 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:32.584671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c53af-6845-4244-822e-8b4a2ed5e98a service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:32.584671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-820c53af-6845-4244-822e-8b4a2ed5e98a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:32.687759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c53af-6845-4244-822e-8b4a2ed5e98a service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:32.693157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:32.694556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:32.694881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:32.695166 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] PATH_INFO: `/v3/users/4412b19087ed40eb8a81193bf33224d8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:32.697053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4412b19087ed40eb8a81193bf33224d8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:32.699019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:32.936312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:32.952451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4412b19087ed40eb8a81193bf33224d8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:32.972718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4412b19087ed40eb8a81193bf33224d8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:33.062791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4412b19087ed40eb8a81193bf33224d8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:33.063608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4412b19087ed40eb8a81193bf33224d8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:33.064707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4412b19087ed40eb8a81193bf33224d8'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:33.082412 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1108/2187] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:32 2022] DELETE /identity/v3/users/4412b19087ed40eb8a81193bf33224d8 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:33.087359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06ea0-4667-4d32-a65d-60a9787d4e26 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:33.088311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06ea0-4667-4d32-a65d-60a9787d4e26 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:33.089293 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc06ea0-4667-4d32-a65d-60a9787d4e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:33.109455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3bc06ea0-4667-4d32-a65d-60a9787d4e26 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:33.110690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3bc06ea0-4667-4d32-a65d-60a9787d4e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:33.178666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1080/2188] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:33.189168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:33.191240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:33.268337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843c43e-47c3-4b2e-8f01-b693d8889789 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:33.272946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde806c9-5cc9-450d-a30e-003e44f8b052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:33.273691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde806c9-5cc9-450d-a30e-003e44f8b052 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:33.273886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde806c9-5cc9-450d-a30e-003e44f8b052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:33.274168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde806c9-5cc9-450d-a30e-003e44f8b052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:33.291327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde806c9-5cc9-450d-a30e-003e44f8b052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:33.292851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde806c9-5cc9-450d-a30e-003e44f8b052 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:33.305795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1109/2189] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:38:33.788968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06ea0-4667-4d32-a65d-60a9787d4e26 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:33.790466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3bc06ea0-4667-4d32-a65d-60a9787d4e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:33.803401 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc06ea0-4667-4d32-a65d-60a9787d4e26 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:33.808012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:33.808948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:33.809260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:33.810415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] PATH_INFO: `/v3/projects/a680a35019b24f3cace00cc42b1f620e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:33.811965 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a680a35019b24f3cace00cc42b1f620e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:33.813903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:33.919568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a680a35019b24f3cace00cc42b1f620e', 'request_id': 'req-3bf6c4a0-07fb-44d0-838a-f578454ad021'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:33.926883 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a680a35019b24f3cace00cc42b1f620e', 'request_id': 'req-3bf6c4a0-07fb-44d0-838a-f578454ad021'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:33.928834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:33.932569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a680a35019b24f3cace00cc42b1f620e', 'request_id': 'req-3bf6c4a0-07fb-44d0-838a-f578454ad021'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:34.049678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] The token cache is being invalidate because project a680a35019b24f3cace00cc42b1f620e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:34.050118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:34.051480 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3bf6c4a0-07fb-44d0-838a-f578454ad021 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:34.062821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1081/2190] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:33 2022] DELETE /identity/v3/projects/a680a35019b24f3cace00cc42b1f620e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:36.973487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde806c9-5cc9-450d-a30e-003e44f8b052 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:36.976707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fde806c9-5cc9-450d-a30e-003e44f8b052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:36.997923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde806c9-5cc9-450d-a30e-003e44f8b052 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:37.099592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:37.100715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:37.100844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:37.101144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] PATH_INFO: `/v3/users/827fb9e02daa4469bc48dcf58caef1c1` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:37.102425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827fb9e02daa4469bc48dcf58caef1c1)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:37.104374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:37.450164 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827fb9e02daa4469bc48dcf58caef1c1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:37.457452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:37.465346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827fb9e02daa4469bc48dcf58caef1c1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:37.524789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827fb9e02daa4469bc48dcf58caef1c1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:37.525462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827fb9e02daa4469bc48dcf58caef1c1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:37.526089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827fb9e02daa4469bc48dcf58caef1c1'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:37.546390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1110/2191] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:36 2022] DELETE /identity/v3/users/827fb9e02daa4469bc48dcf58caef1c1 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:37.550582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b85d46-7cf5-4dd4-8550-5cef6a9f030e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:37.551625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b85d46-7cf5-4dd4-8550-5cef6a9f030e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:37.552206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b85d46-7cf5-4dd4-8550-5cef6a9f030e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:37.574954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-42b85d46-7cf5-4dd4-8550-5cef6a9f030e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:37.587440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-42b85d46-7cf5-4dd4-8550-5cef6a9f030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:37.672374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1082/2192] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:37.679535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:37.681005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:37.750741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d439d741-f7f4-48ca-baa4-8fe36c7c0e03 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:37.757687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685e388-51be-4d1a-9248-419b909a8174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:37.758346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685e388-51be-4d1a-9248-419b909a8174 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:37.758630 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685e388-51be-4d1a-9248-419b909a8174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:37.758988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685e388-51be-4d1a-9248-419b909a8174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:37.768519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685e388-51be-4d1a-9248-419b909a8174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:37.770564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685e388-51be-4d1a-9248-419b909a8174 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:37.780385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1111/2193] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:38.475343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b85d46-7cf5-4dd4-8550-5cef6a9f030e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:38.475343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-42b85d46-7cf5-4dd4-8550-5cef6a9f030e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:38.483961 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b85d46-7cf5-4dd4-8550-5cef6a9f030e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:38.493905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:38.494782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:38.495060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:38.495330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] PATH_INFO: `/v3/projects/3d3e20e83abc4cdba38e42a1aba8e509` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:38.496576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d3e20e83abc4cdba38e42a1aba8e509)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:38.498502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:38.659601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d3e20e83abc4cdba38e42a1aba8e509', 'request_id': 'req-502f7452-0301-4945-b14b-f6aaf80a9fb9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:38.665814 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d3e20e83abc4cdba38e42a1aba8e509', 'request_id': 'req-502f7452-0301-4945-b14b-f6aaf80a9fb9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:38.671491 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d3e20e83abc4cdba38e42a1aba8e509', 'request_id': 'req-502f7452-0301-4945-b14b-f6aaf80a9fb9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:38.825645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] The token cache is being invalidate because project 3d3e20e83abc4cdba38e42a1aba8e509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:38.832118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:38.832118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:38.832118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1083/2194] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:38 2022] DELETE /identity/v3/projects/3d3e20e83abc4cdba38e42a1aba8e509 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:38.833042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685e388-51be-4d1a-9248-419b909a8174 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:38.843949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685e388-51be-4d1a-9248-419b909a8174 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:38.938647 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:38.939538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:38.939816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:38.940088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] PATH_INFO: `/v3/users/b073b1322864493ca6e413fa6c8681b3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:38.941582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] RBAC: Authorizing `identity:delete_user(user_id=b073b1322864493ca6e413fa6c8681b3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:38.943736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:39.299190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b073b1322864493ca6e413fa6c8681b3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:39.313301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b073b1322864493ca6e413fa6c8681b3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:39.451098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b073b1322864493ca6e413fa6c8681b3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:39.452180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b073b1322864493ca6e413fa6c8681b3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:39.453028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b073b1322864493ca6e413fa6c8681b3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:39.456004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:39.479155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1112/2195] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:38 2022] DELETE /identity/v3/users/b073b1322864493ca6e413fa6c8681b3 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:40.356348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:40.358314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:40.379968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f7452-0301-4945-b14b-f6aaf80a9fb9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:40.455546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:40.457235 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:40.457570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:40.457823 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] PATH_INFO: `/v3/projects/e313e9fc18114c02b6ecd81968e8c30e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:40.459021 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e313e9fc18114c02b6ecd81968e8c30e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:40.461699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:40.492925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:40.614974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e313e9fc18114c02b6ecd81968e8c30e', 'request_id': 'req-f935f4c0-d916-4ac1-af91-12a3b9983654'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:40.629361 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e313e9fc18114c02b6ecd81968e8c30e', 'request_id': 'req-f935f4c0-d916-4ac1-af91-12a3b9983654'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:40.637178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e313e9fc18114c02b6ecd81968e8c30e', 'request_id': 'req-f935f4c0-d916-4ac1-af91-12a3b9983654'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:40.731203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] The token cache is being invalidate because project e313e9fc18114c02b6ecd81968e8c30e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:40.731764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:40.732402 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:40.734303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1084/2196] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:40 2022] DELETE /identity/v3/projects/e313e9fc18114c02b6ecd81968e8c30e => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:40.738745 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:40.740942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:40.754698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf816cc-7109-44cf-8f43-4935068abead admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:40.816523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:40.817551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:40.817744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:40.818019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] PATH_INFO: `/v3/users/962581f9a6094d94864612c305794c09` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:40.819275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=962581f9a6094d94864612c305794c09)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:40.821292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:41.130923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962581f9a6094d94864612c305794c09'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:41.143220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962581f9a6094d94864612c305794c09'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:41.262496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962581f9a6094d94864612c305794c09'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:41.263148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962581f9a6094d94864612c305794c09'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:41.263750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a0a6cf0f-f54e-4ffc-8947-2e6a51fb5d17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962581f9a6094d94864612c305794c09'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:41.277257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1113/2197] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:40 2022] DELETE /identity/v3/users/962581f9a6094d94864612c305794c09 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:41.951373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:41.953827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:41.969755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935f4c0-d916-4ac1-af91-12a3b9983654 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:42.083127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:42.084280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.084671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.085022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] PATH_INFO: `/v3/projects/e15392907e0d493d88c2d25e134b0322` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.086324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15392907e0d493d88c2d25e134b0322)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:42.088328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:42.216733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15392907e0d493d88c2d25e134b0322', 'request_id': 'req-0b93132d-95e8-42c9-b045-d7eb1597d205'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:42.223843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15392907e0d493d88c2d25e134b0322', 'request_id': 'req-0b93132d-95e8-42c9-b045-d7eb1597d205'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:42.229271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15392907e0d493d88c2d25e134b0322', 'request_id': 'req-0b93132d-95e8-42c9-b045-d7eb1597d205'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:42.286478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] The token cache is being invalidate because project e15392907e0d493d88c2d25e134b0322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:42.287010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:42.287659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-0b93132d-95e8-42c9-b045-d7eb1597d205 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:42.289459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1085/2198] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:41 2022] DELETE /identity/v3/projects/e15392907e0d493d88c2d25e134b0322 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:42.294583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a5dc8-ec49-411b-8257-8ad3fc0fed74 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.295181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a5dc8-ec49-411b-8257-8ad3fc0fed74 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.295350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a5dc8-ec49-411b-8257-8ad3fc0fed74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.337325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-417a5dc8-ec49-411b-8257-8ad3fc0fed74 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:42.338678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-417a5dc8-ec49-411b-8257-8ad3fc0fed74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:42.408002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1114/2199] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:42.418253 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d826d12-2c13-41e9-847a-840a2100b77d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.418641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d826d12-2c13-41e9-847a-840a2100b77d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.418982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d826d12-2c13-41e9-847a-840a2100b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.438224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-8d826d12-2c13-41e9-847a-840a2100b77d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:42.439429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8d826d12-2c13-41e9-847a-840a2100b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:42.447694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1086/2200] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:42.452284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a5dc8-ec49-411b-8257-8ad3fc0fed74 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:42.457674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:42.462865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417a5dc8-ec49-411b-8257-8ad3fc0fed74 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:42.467449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b342d-6ec1-4eec-adb9-d5399b7f024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:42.470693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b342d-6ec1-4eec-adb9-d5399b7f024d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.470693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b342d-6ec1-4eec-adb9-d5399b7f024d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.470693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b342d-6ec1-4eec-adb9-d5399b7f024d admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.470693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b342d-6ec1-4eec-adb9-d5399b7f024d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:38:42.470693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b342d-6ec1-4eec-adb9-d5399b7f024d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:42.471715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b342d-6ec1-4eec-adb9-d5399b7f024d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:42.483949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1115/2201] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:38:42.488607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d826d12-2c13-41e9-847a-840a2100b77d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:42.498534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d826d12-2c13-41e9-847a-840a2100b77d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:42.503851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6cfe65-ae9f-4c21-becd-3528ce27626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:42.504747 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cfe65-ae9f-4c21-becd-3528ce27626b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.505057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cfe65-ae9f-4c21-becd-3528ce27626b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.505336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6cfe65-ae9f-4c21-becd-3528ce27626b admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.506236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cfe65-ae9f-4c21-becd-3528ce27626b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:42.508120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6cfe65-ae9f-4c21-becd-3528ce27626b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:42.611893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:42.618559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1087/2202] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:42 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:42.622502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b342d-6ec1-4eec-adb9-d5399b7f024d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:42.633281 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b342d-6ec1-4eec-adb9-d5399b7f024d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:42.664791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7324041-7afb-412a-bfb9-25e17cd3481c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.665084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7324041-7afb-412a-bfb9-25e17cd3481c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.665364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7324041-7afb-412a-bfb9-25e17cd3481c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.683249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e7324041-7afb-412a-bfb9-25e17cd3481c None None] MFA Rules not processed for user `0487ea9076ee4baf8138fdc25ce02522`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:42.684440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e7324041-7afb-412a-bfb9-25e17cd3481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:42.689425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d3b1-d043-4cd5-9dd4-8ed4c132b564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:42.690098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d3b1-d043-4cd5-9dd4-8ed4c132b564 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.690378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d3b1-d043-4cd5-9dd4-8ed4c132b564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.690649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198d3b1-d043-4cd5-9dd4-8ed4c132b564 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.692107 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d3b1-d043-4cd5-9dd4-8ed4c132b564 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:42.694073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198d3b1-d043-4cd5-9dd4-8ed4c132b564 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:42.744651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1088/2203] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:38:42.814245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1116/2204] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:42 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:38:42.815654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7324041-7afb-412a-bfb9-25e17cd3481c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:42.829359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7324041-7afb-412a-bfb9-25e17cd3481c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:42.835470 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cc5de-ac95-429f-bbdc-5b7d24b720bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:42.836261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cc5de-ac95-429f-bbdc-5b7d24b720bb admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.836710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cc5de-ac95-429f-bbdc-5b7d24b720bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.837052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cc5de-ac95-429f-bbdc-5b7d24b720bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.837854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cc5de-ac95-429f-bbdc-5b7d24b720bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:42.839582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cc5de-ac95-429f-bbdc-5b7d24b720bb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:42.852527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1089/2205] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:42.857654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d3b1-d043-4cd5-9dd4-8ed4c132b564 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:42.867589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198d3b1-d043-4cd5-9dd4-8ed4c132b564 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:42.872927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746139e-3f84-4876-927b-13a81335ca2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:42.873600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746139e-3f84-4876-927b-13a81335ca2a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.873883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746139e-3f84-4876-927b-13a81335ca2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.874155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746139e-3f84-4876-927b-13a81335ca2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.874881 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746139e-3f84-4876-927b-13a81335ca2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:42.876687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746139e-3f84-4876-927b-13a81335ca2a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:42.890311 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1117/2206] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:42.895604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cc5de-ac95-429f-bbdc-5b7d24b720bb admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:42.906533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cc5de-ac95-429f-bbdc-5b7d24b720bb admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:42.912626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30714134-d2a2-4c30-8116-849599ac7592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:42.913727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30714134-d2a2-4c30-8116-849599ac7592 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:42.914189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30714134-d2a2-4c30-8116-849599ac7592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:42.914598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30714134-d2a2-4c30-8116-849599ac7592 admin admin] PATH_INFO: `/v3/projects/200c28fbfe02445e947d289ab4d36793/users/c2c35b5419b14e288746992ca45065e5/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:42.936538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30714134-d2a2-4c30-8116-849599ac7592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=200c28fbfe02445e947d289ab4d36793, user_id=c2c35b5419b14e288746992ca45065e5, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:42.939177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30714134-d2a2-4c30-8116-849599ac7592 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:43.069457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1090/2207] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:42 2022] PUT /identity/v3/projects/200c28fbfe02445e947d289ab4d36793/users/c2c35b5419b14e288746992ca45065e5/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:43.081177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d8ad8-1122-4f95-b7b9-ede2bcb2d6ba None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:43.081540 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d8ad8-1122-4f95-b7b9-ede2bcb2d6ba None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:43.082366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d8ad8-1122-4f95-b7b9-ede2bcb2d6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:43.152334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30714134-d2a2-4c30-8116-849599ac7592 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:43.157417 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-30714134-d2a2-4c30-8116-849599ac7592 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:43.196759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a80d8ad8-1122-4f95-b7b9-ede2bcb2d6ba None None] MFA Rules not processed for user `c2c35b5419b14e288746992ca45065e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:43.198388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a80d8ad8-1122-4f95-b7b9-ede2bcb2d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:43.297457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30714134-d2a2-4c30-8116-849599ac7592 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:43.320977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1118/2208] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:43.329696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:43.330758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:43.331187 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:43.332207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] PATH_INFO: `/v3/users/11e8bfa0f286449d98af1d8135e42319` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:43.341895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=11e8bfa0f286449d98af1d8135e42319)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:43.341895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:43.342269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d8ad8-1122-4f95-b7b9-ede2bcb2d6ba None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:43.342269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a80d8ad8-1122-4f95-b7b9-ede2bcb2d6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:43.428211 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d8ad8-1122-4f95-b7b9-ede2bcb2d6ba None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:43.433777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0a3b8-8b5c-4401-8b9a-3144f69c9f0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:43.434596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0a3b8-8b5c-4401-8b9a-3144f69c9f0b service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:43.435046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0a3b8-8b5c-4401-8b9a-3144f69c9f0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:43.435453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0a3b8-8b5c-4401-8b9a-3144f69c9f0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:43.447338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0a3b8-8b5c-4401-8b9a-3144f69c9f0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:43.448842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0a3b8-8b5c-4401-8b9a-3144f69c9f0b service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:43.458417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1119/2209] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:38:43.581520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11e8bfa0f286449d98af1d8135e42319'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:43.596327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11e8bfa0f286449d98af1d8135e42319'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:43.597768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11e8bfa0f286449d98af1d8135e42319'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:43.612314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11e8bfa0f286449d98af1d8135e42319'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:43.613641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11e8bfa0f286449d98af1d8135e42319'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:43.685114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1091/2210] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:43 2022] DELETE /identity/v3/users/11e8bfa0f286449d98af1d8135e42319 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:43.690092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f11d5-f9ed-48c0-9e12-1c6d22229471 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:43.690385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f11d5-f9ed-48c0-9e12-1c6d22229471 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:43.690751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f11d5-f9ed-48c0-9e12-1c6d22229471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:43.708976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9c2f11d5-f9ed-48c0-9e12-1c6d22229471 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:43.714746 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9c2f11d5-f9ed-48c0-9e12-1c6d22229471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:43.767226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1120/2211] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:43.779512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:43.781253 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:43.842343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d8970-7e53-4a53-a907-5668f8166fda admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:43.846365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d522703-f76e-4fe2-937a-5068ece984ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:43.847103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d522703-f76e-4fe2-937a-5068ece984ef service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:43.847967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d522703-f76e-4fe2-937a-5068ece984ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:43.848297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d522703-f76e-4fe2-937a-5068ece984ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:43.866150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d522703-f76e-4fe2-937a-5068ece984ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:43.867996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d522703-f76e-4fe2-937a-5068ece984ef service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:43.879596 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1092/2212] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:44.388997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f11d5-f9ed-48c0-9e12-1c6d22229471 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:44.390493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9c2f11d5-f9ed-48c0-9e12-1c6d22229471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:44.412577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f11d5-f9ed-48c0-9e12-1c6d22229471 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:44.418499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:44.420599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:44.420599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:44.420599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] PATH_INFO: `/v3/projects/c9b5acb33e7d43aebde8ddac9749eefe` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:44.421845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b5acb33e7d43aebde8ddac9749eefe)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:44.423901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:44.554272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b5acb33e7d43aebde8ddac9749eefe', 'request_id': 'req-85dd5f19-d837-4270-ba18-babfd142b7f3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:44.560244 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b5acb33e7d43aebde8ddac9749eefe', 'request_id': 'req-85dd5f19-d837-4270-ba18-babfd142b7f3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:44.565744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b5acb33e7d43aebde8ddac9749eefe', 'request_id': 'req-85dd5f19-d837-4270-ba18-babfd142b7f3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:44.651272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] The token cache is being invalidate because project c9b5acb33e7d43aebde8ddac9749eefe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:44.651647 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:44.652380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-85dd5f19-d837-4270-ba18-babfd142b7f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:44.658568 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1121/2213] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:44 2022] DELETE /identity/v3/projects/c9b5acb33e7d43aebde8ddac9749eefe => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:45.096952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:45.312170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14ea5d-3bb8-4e5c-b1c7-3935d6abb601 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:45.312750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14ea5d-3bb8-4e5c-b1c7-3935d6abb601 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:45.312750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14ea5d-3bb8-4e5c-b1c7-3935d6abb601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:45.331790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ef14ea5d-3bb8-4e5c-b1c7-3935d6abb601 None None] MFA Rules not processed for user `c2c35b5419b14e288746992ca45065e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:45.333386 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ef14ea5d-3bb8-4e5c-b1c7-3935d6abb601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:45.400646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1093/2214] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:45.663425 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:49.916603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e4680-2167-455d-80d5-bf582b54f406 None None] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:49.917146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e4680-2167-455d-80d5-bf582b54f406 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:49.917146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e4680-2167-455d-80d5-bf582b54f406 None None] PATH_INFO: `/` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:49.918597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1122/2215] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:38:49.931469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1035907-8e8e-432b-9907-3b68a91a1604 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:49.932139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1035907-8e8e-432b-9907-3b68a91a1604 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:49.932619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1035907-8e8e-432b-9907-3b68a91a1604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:49.998594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d1035907-8e8e-432b-9907-3b68a91a1604 None None] MFA Rules not processed for user `762b38d08d2447bfbc968245a5b2915f`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:49.999729 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d1035907-8e8e-432b-9907-3b68a91a1604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:50.063506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:50.083218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1094/2216] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:38:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:50.095291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e4680-2167-455d-80d5-bf582b54f406 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:50.097594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7e3e4680-2167-455d-80d5-bf582b54f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:50.122205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e4680-2167-455d-80d5-bf582b54f406 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:50.127940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508063e-93f9-40f6-a050-eca5531dc21f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:50.130581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508063e-93f9-40f6-a050-eca5531dc21f service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:50.131059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508063e-93f9-40f6-a050-eca5531dc21f service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:50.131712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0508063e-93f9-40f6-a050-eca5531dc21f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:50.142679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508063e-93f9-40f6-a050-eca5531dc21f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:50.144739 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0508063e-93f9-40f6-a050-eca5531dc21f service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:50.161785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1123/2217] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:38:51.186154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1035907-8e8e-432b-9907-3b68a91a1604 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:51.189534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d1035907-8e8e-432b-9907-3b68a91a1604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:51.264968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1035907-8e8e-432b-9907-3b68a91a1604 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:51.268633 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:51.270210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:51.270677 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:51.270955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] PATH_INFO: `/v3/users/ca77e354876a4fe1822541d900590b62` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:51.272245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca77e354876a4fe1822541d900590b62)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:51.274275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:51.625835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca77e354876a4fe1822541d900590b62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:51.638779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca77e354876a4fe1822541d900590b62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:51.639971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca77e354876a4fe1822541d900590b62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:51.672582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca77e354876a4fe1822541d900590b62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:51.673559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca77e354876a4fe1822541d900590b62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:51.766782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1095/2218] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:51 2022] DELETE /identity/v3/users/ca77e354876a4fe1822541d900590b62 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:52.623291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508063e-93f9-40f6-a050-eca5531dc21f service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:52.640741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0508063e-93f9-40f6-a050-eca5531dc21f service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:52.721548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:52.722667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:52.723101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:52.723644 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] PATH_INFO: `/v3/projects/26533765b74640e9b40211155aaf41b6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:52.724918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=26533765b74640e9b40211155aaf41b6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:52.727231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:52.742462 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:52.889888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26533765b74640e9b40211155aaf41b6', 'request_id': 'req-7b7a8749-f78c-4f42-9376-78d621ffd8ad'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:52.898157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26533765b74640e9b40211155aaf41b6', 'request_id': 'req-7b7a8749-f78c-4f42-9376-78d621ffd8ad'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:52.905756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26533765b74640e9b40211155aaf41b6', 'request_id': 'req-7b7a8749-f78c-4f42-9376-78d621ffd8ad'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:53.006160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] The token cache is being invalidate because project 26533765b74640e9b40211155aaf41b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:53.006509 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:53.007905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:53.010128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1124/2219] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:52 2022] DELETE /identity/v3/projects/26533765b74640e9b40211155aaf41b6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:38:53.014188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:53.016412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:53.047702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784c2ce1-68d4-4fe0-91f8-2bd005e3f5c1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:53.112048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:53.113533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:53.113775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:53.114049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] PATH_INFO: `/v3/users/01e96d1332cd4940aa2b31109eaca2eb` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:53.115303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e96d1332cd4940aa2b31109eaca2eb)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:53.117529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:53.131270 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:53.393241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e96d1332cd4940aa2b31109eaca2eb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:53.402796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e96d1332cd4940aa2b31109eaca2eb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:53.403310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e96d1332cd4940aa2b31109eaca2eb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:53.421854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e96d1332cd4940aa2b31109eaca2eb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:53.422504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bc8070b8-a966-4cc6-9090-af2138a010c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e96d1332cd4940aa2b31109eaca2eb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:53.508279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1096/2220] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:38:53 2022] DELETE /identity/v3/users/01e96d1332cd4940aa2b31109eaca2eb => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:53.848249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:53.849738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:53.864532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a8749-f78c-4f42-9376-78d621ffd8ad admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:53.931991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:53.932825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:53.933109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:53.933412 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] PATH_INFO: `/v3/projects/fd4e4551b32b4fd081cc016c73715894` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:53.934601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd4e4551b32b4fd081cc016c73715894)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:53.936604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:54.127357 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd4e4551b32b4fd081cc016c73715894', 'request_id': 'req-7ca016c4-33e2-463f-b603-8e15faa62640'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:54.134729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd4e4551b32b4fd081cc016c73715894', 'request_id': 'req-7ca016c4-33e2-463f-b603-8e15faa62640'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:54.142308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd4e4551b32b4fd081cc016c73715894', 'request_id': 'req-7ca016c4-33e2-463f-b603-8e15faa62640'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:54.298792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] The token cache is being invalidate because project fd4e4551b32b4fd081cc016c73715894 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:38:54.299303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:54.301577 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7ca016c4-33e2-463f-b603-8e15faa62640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:38:54.303357 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1125/2221] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:38:53 2022] DELETE /identity/v3/projects/fd4e4551b32b4fd081cc016c73715894 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:54.309234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d7f10-7c17-4d8f-a219-72aba236b052 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:54.309645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d7f10-7c17-4d8f-a219-72aba236b052 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:54.309969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d7f10-7c17-4d8f-a219-72aba236b052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:54.330746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-608d7f10-7c17-4d8f-a219-72aba236b052 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:54.332348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-608d7f10-7c17-4d8f-a219-72aba236b052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:54.414436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1097/2222] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:54.422199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428f8e-6912-4a5f-8610-8b6770141420 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:54.422489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428f8e-6912-4a5f-8610-8b6770141420 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:54.422766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428f8e-6912-4a5f-8610-8b6770141420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:54.442521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-51428f8e-6912-4a5f-8610-8b6770141420 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:54.443705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-51428f8e-6912-4a5f-8610-8b6770141420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:54.451522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1126/2223] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:38:54.455720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d7f10-7c17-4d8f-a219-72aba236b052 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:54.465741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d7f10-7c17-4d8f-a219-72aba236b052 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:54.470339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b66ca9-838b-4a43-9b19-4898f17127c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:54.471057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b66ca9-838b-4a43-9b19-4898f17127c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:54.471543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b66ca9-838b-4a43-9b19-4898f17127c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:54.471815 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b66ca9-838b-4a43-9b19-4898f17127c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:54.472738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b66ca9-838b-4a43-9b19-4898f17127c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:38:54.473049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b66ca9-838b-4a43-9b19-4898f17127c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:54.474648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b66ca9-838b-4a43-9b19-4898f17127c3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:54.486853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1098/2224] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:38:54.491566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51428f8e-6912-4a5f-8610-8b6770141420 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:54.501863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51428f8e-6912-4a5f-8610-8b6770141420 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:54.510427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b1f71-fd94-4ef4-a759-0710624dd330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:54.511471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b1f71-fd94-4ef4-a759-0710624dd330 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:54.511837 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b1f71-fd94-4ef4-a759-0710624dd330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:54.512191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b1f71-fd94-4ef4-a759-0710624dd330 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:54.513046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b1f71-fd94-4ef4-a759-0710624dd330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:54.515238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b1f71-fd94-4ef4-a759-0710624dd330 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:54.604308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1127/2225] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:38:54 2022] POST /identity/v3/projects => generated 363 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:38:54.608783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b66ca9-838b-4a43-9b19-4898f17127c3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:54.622363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b66ca9-838b-4a43-9b19-4898f17127c3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:54.687242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec66223-8a2b-4061-a3b1-0da0156a6e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:54.687928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec66223-8a2b-4061-a3b1-0da0156a6e57 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:54.688215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec66223-8a2b-4061-a3b1-0da0156a6e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:54.688662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec66223-8a2b-4061-a3b1-0da0156a6e57 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:54.689413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec66223-8a2b-4061-a3b1-0da0156a6e57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:54.691405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec66223-8a2b-4061-a3b1-0da0156a6e57 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:54.863955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1099/2226] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:38:54 2022] POST /identity/v3/users => generated 282 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:38:54.868088 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b1f71-fd94-4ef4-a759-0710624dd330 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:54.873844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:54.879525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b1f71-fd94-4ef4-a759-0710624dd330 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:54.884143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6ffa5-4ffe-4f7f-82cc-0eb6ef82815e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:54.884843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ffa5-4ffe-4f7f-82cc-0eb6ef82815e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:54.885129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ffa5-4ffe-4f7f-82cc-0eb6ef82815e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:54.885406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c6ffa5-4ffe-4f7f-82cc-0eb6ef82815e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:54.886164 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ffa5-4ffe-4f7f-82cc-0eb6ef82815e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:54.887771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c6ffa5-4ffe-4f7f-82cc-0eb6ef82815e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:54.898639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1128/2227] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:38:54.906841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec66223-8a2b-4061-a3b1-0da0156a6e57 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:54.918632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec66223-8a2b-4061-a3b1-0da0156a6e57 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:54.923686 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3986c41b-238c-4ca2-ab23-40ef1c7022c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:54.924436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986c41b-238c-4ca2-ab23-40ef1c7022c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:54.924839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986c41b-238c-4ca2-ab23-40ef1c7022c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:54.925184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3986c41b-238c-4ca2-ab23-40ef1c7022c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:54.926829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986c41b-238c-4ca2-ab23-40ef1c7022c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:54.931609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3986c41b-238c-4ca2-ab23-40ef1c7022c8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:54.931609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:54.942006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1100/2228] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:38:54.946215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6ffa5-4ffe-4f7f-82cc-0eb6ef82815e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:54.956502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c6ffa5-4ffe-4f7f-82cc-0eb6ef82815e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:54.961934 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40616e40-c78f-44c2-a955-978d7d318283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:54.962816 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40616e40-c78f-44c2-a955-978d7d318283 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:54.963124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40616e40-c78f-44c2-a955-978d7d318283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:54.963441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40616e40-c78f-44c2-a955-978d7d318283 admin admin] PATH_INFO: `/v3/projects/6467b70f536148c596f4b6bef109f1a2/users/7f4e8b5acca64d35b3ae6bf5b5333428/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:54.978286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40616e40-c78f-44c2-a955-978d7d318283 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6467b70f536148c596f4b6bef109f1a2, user_id=7f4e8b5acca64d35b3ae6bf5b5333428, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:54.981016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40616e40-c78f-44c2-a955-978d7d318283 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:55.079749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1129/2229] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:38:54 2022] PUT /identity/v3/projects/6467b70f536148c596f4b6bef109f1a2/users/7f4e8b5acca64d35b3ae6bf5b5333428/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:38:55.090630 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722289f-e846-4261-bad1-9112c1ac59c9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:55.090918 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722289f-e846-4261-bad1-9112c1ac59c9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:55.091193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722289f-e846-4261-bad1-9112c1ac59c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:55.119359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c722289f-e846-4261-bad1-9112c1ac59c9 None None] MFA Rules not processed for user `7f4e8b5acca64d35b3ae6bf5b5333428`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:38:55.120601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c722289f-e846-4261-bad1-9112c1ac59c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:55.190873 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1101/2230] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:38:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:38:55.198601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40616e40-c78f-44c2-a955-978d7d318283 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:38:55.200329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-40616e40-c78f-44c2-a955-978d7d318283 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:38:55.284086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40616e40-c78f-44c2-a955-978d7d318283 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:38:55.288518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282483f-72fa-4ff2-90d2-a7faef8acc1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:38:55.289191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282483f-72fa-4ff2-90d2-a7faef8acc1a service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:38:55.289470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282483f-72fa-4ff2-90d2-a7faef8acc1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:38:55.289825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0282483f-72fa-4ff2-90d2-a7faef8acc1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:38:55.298813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282483f-72fa-4ff2-90d2-a7faef8acc1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:38:55.300328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0282483f-72fa-4ff2-90d2-a7faef8acc1a service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:38:55.309969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1130/2231] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:38:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:39:01.111937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc7a5a-2e2e-49b2-bad3-6c7d2b82a6de None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:01.112420 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc7a5a-2e2e-49b2-bad3-6c7d2b82a6de None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:01.112684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cc7a5a-2e2e-49b2-bad3-6c7d2b82a6de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:01.132678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-41cc7a5a-2e2e-49b2-bad3-6c7d2b82a6de None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:01.133891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-41cc7a5a-2e2e-49b2-bad3-6c7d2b82a6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:01.200354 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1102/2232] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:39:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:01.242907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282483f-72fa-4ff2-90d2-a7faef8acc1a service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:01.244343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0282483f-72fa-4ff2-90d2-a7faef8acc1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:01.327769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0282483f-72fa-4ff2-90d2-a7faef8acc1a service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:01.334060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da4b8-ac48-4c09-b920-f57b2f86a7dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:01.334854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da4b8-ac48-4c09-b920-f57b2f86a7dc service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:01.335309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da4b8-ac48-4c09-b920-f57b2f86a7dc service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:01.335593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da4b8-ac48-4c09-b920-f57b2f86a7dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:01.345913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49da4b8-ac48-4c09-b920-f57b2f86a7dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:01.347592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49da4b8-ac48-4c09-b920-f57b2f86a7dc service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:01.360835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1131/2233] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:39:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:39:11.193453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=62 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:11.354509 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=81,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:11.428676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad172e-d183-4a62-b2c8-74bf4b15ddde None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:11.429124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad172e-d183-4a62-b2c8-74bf4b15ddde None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:11.429610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad172e-d183-4a62-b2c8-74bf4b15ddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:11.489332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f3ad172e-d183-4a62-b2c8-74bf4b15ddde None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:11.491087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f3ad172e-d183-4a62-b2c8-74bf4b15ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:11.511213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1103/2234] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:39:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:11.526141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da4b8-ac48-4c09-b920-f57b2f86a7dc service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:11.549937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da4b8-ac48-4c09-b920-f57b2f86a7dc service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:11.563221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb8fba-6c30-4b43-8d9c-b08a7ee27419 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:11.570603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb8fba-6c30-4b43-8d9c-b08a7ee27419 service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:11.570603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb8fba-6c30-4b43-8d9c-b08a7ee27419 service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:11.570603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb8fba-6c30-4b43-8d9c-b08a7ee27419 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:11.573534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb8fba-6c30-4b43-8d9c-b08a7ee27419 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:11.576955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb8fba-6c30-4b43-8d9c-b08a7ee27419 service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:11.595905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1132/2235] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:39:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 07:39:13.977534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410790-fbf4-48f9-a3b7-07af4a756515 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:13.978033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410790-fbf4-48f9-a3b7-07af4a756515 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:13.978125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b410790-fbf4-48f9-a3b7-07af4a756515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:13.996884 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7b410790-fbf4-48f9-a3b7-07af4a756515 None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:13.998078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7b410790-fbf4-48f9-a3b7-07af4a756515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:14.005969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1104/2236] 10.222.0.24 () {58 vars in 967 bytes} [Wed May 25 07:39:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:14.018232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb8fba-6c30-4b43-8d9c-b08a7ee27419 service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:14.029381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb8fba-6c30-4b43-8d9c-b08a7ee27419 service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:14.034453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9dc83-4d66-4762-b514-53e5820a4a56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:14.035460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9dc83-4d66-4762-b514-53e5820a4a56 service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:14.035907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9dc83-4d66-4762-b514-53e5820a4a56 service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:14.036388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9dc83-4d66-4762-b514-53e5820a4a56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:14.045701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9dc83-4d66-4762-b514-53e5820a4a56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:14.047473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9dc83-4d66-4762-b514-53e5820a4a56 service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:14.063408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1133/2237] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:39:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:39:14.844296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a8e0-59aa-4c07-b01a-bfd32eff6d85 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:14.844642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a8e0-59aa-4c07-b01a-bfd32eff6d85 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:14.844908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc81a8e0-59aa-4c07-b01a-bfd32eff6d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:14.863813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-cc81a8e0-59aa-4c07-b01a-bfd32eff6d85 None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:14.865050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-cc81a8e0-59aa-4c07-b01a-bfd32eff6d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:14.872262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1105/2238] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:39:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:39:14.889801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9dc83-4d66-4762-b514-53e5820a4a56 service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:14.901540 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9dc83-4d66-4762-b514-53e5820a4a56 service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:14.906444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f195c-3394-4926-a294-dda554360d64 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:14.907073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f195c-3394-4926-a294-dda554360d64 service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:14.907353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f195c-3394-4926-a294-dda554360d64 service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:14.907632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f195c-3394-4926-a294-dda554360d64 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:14.916147 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f195c-3394-4926-a294-dda554360d64 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:14.917775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458f195c-3394-4926-a294-dda554360d64 service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:14.926567 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1134/2239] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:39:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:39:15.615774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be92b6a-d711-4c59-9fd1-0ac21f393fff None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:15.616260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be92b6a-d711-4c59-9fd1-0ac21f393fff None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:15.616374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be92b6a-d711-4c59-9fd1-0ac21f393fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:15.635647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5be92b6a-d711-4c59-9fd1-0ac21f393fff None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:15.636892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5be92b6a-d711-4c59-9fd1-0ac21f393fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:15.643997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1106/2240] 10.222.0.24 () {58 vars in 967 bytes} [Wed May 25 07:39:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:15.656316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f195c-3394-4926-a294-dda554360d64 service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:15.667591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f195c-3394-4926-a294-dda554360d64 service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:15.673050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953f812-2659-45a5-9304-356c31fd2a9b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:15.673744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953f812-2659-45a5-9304-356c31fd2a9b service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:15.674031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953f812-2659-45a5-9304-356c31fd2a9b service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:15.674408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953f812-2659-45a5-9304-356c31fd2a9b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:15.685243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953f812-2659-45a5-9304-356c31fd2a9b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:15.686915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f953f812-2659-45a5-9304-356c31fd2a9b service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:15.695603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1135/2241] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:39:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:39:18.484445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be92b6a-d711-4c59-9fd1-0ac21f393fff None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:18.485910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5be92b6a-d711-4c59-9fd1-0ac21f393fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:18.556829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be92b6a-d711-4c59-9fd1-0ac21f393fff None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:18.561244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:18.562118 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:18.562398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:18.562672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] PATH_INFO: `/v3/users/c2c35b5419b14e288746992ca45065e5` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:18.564041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2c35b5419b14e288746992ca45065e5)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:18.566554 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:18.782942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2c35b5419b14e288746992ca45065e5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:18.791700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2c35b5419b14e288746992ca45065e5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:18.792390 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2c35b5419b14e288746992ca45065e5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:18.805812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2c35b5419b14e288746992ca45065e5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:18.806527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2c35b5419b14e288746992ca45065e5'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:18.880838 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1107/2242] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:39:18 2022] DELETE /identity/v3/users/c2c35b5419b14e288746992ca45065e5 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:39:18.885307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319dcd9-7e06-4e36-9176-fbef83243099 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:18.885783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319dcd9-7e06-4e36-9176-fbef83243099 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:18.885902 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e319dcd9-7e06-4e36-9176-fbef83243099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:18.904005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e319dcd9-7e06-4e36-9176-fbef83243099 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:18.905434 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e319dcd9-7e06-4e36-9176-fbef83243099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:18.977295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1136/2243] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:39:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:18.987466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:18.988901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:19.012072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:19.050356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715aa4a5-185f-41f6-b456-605e4fe79449 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:19.054011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c0c35-4e90-42b7-9e59-c7ccb982190a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:19.054659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0c35-4e90-42b7-9e59-c7ccb982190a service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:19.054941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0c35-4e90-42b7-9e59-c7ccb982190a service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:19.055222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c0c35-4e90-42b7-9e59-c7ccb982190a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:19.065232 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c0c35-4e90-42b7-9e59-c7ccb982190a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:19.066811 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c0c35-4e90-42b7-9e59-c7ccb982190a service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:19.076969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1108/2244] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:39:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:39:19.368969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319dcd9-7e06-4e36-9176-fbef83243099 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:19.370975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e319dcd9-7e06-4e36-9176-fbef83243099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:19.384491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e319dcd9-7e06-4e36-9176-fbef83243099 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:19.391644 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:19.392651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:19.393082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:19.393419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] PATH_INFO: `/v3/projects/200c28fbfe02445e947d289ab4d36793` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:19.394639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200c28fbfe02445e947d289ab4d36793)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:19.397555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:19.492327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200c28fbfe02445e947d289ab4d36793', 'request_id': 'req-fdbce6cf-43bc-4dff-84b6-89612b22f243'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:19.499168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200c28fbfe02445e947d289ab4d36793', 'request_id': 'req-fdbce6cf-43bc-4dff-84b6-89612b22f243'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:19.505317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200c28fbfe02445e947d289ab4d36793', 'request_id': 'req-fdbce6cf-43bc-4dff-84b6-89612b22f243'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:19.593927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] The token cache is being invalidate because project 200c28fbfe02445e947d289ab4d36793 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:39:19.594223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:19.594896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-fdbce6cf-43bc-4dff-84b6-89612b22f243 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:19.596613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1137/2245] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:39:19 2022] DELETE /identity/v3/projects/200c28fbfe02445e947d289ab4d36793 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:39:19.602451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d47e6f-ee49-487c-953e-7c28e51ea14b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:19.603063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d47e6f-ee49-487c-953e-7c28e51ea14b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:19.603063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d47e6f-ee49-487c-953e-7c28e51ea14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:19.621458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-43d47e6f-ee49-487c-953e-7c28e51ea14b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:19.622644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-43d47e6f-ee49-487c-953e-7c28e51ea14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:19.682716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1109/2246] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:39:19.690648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948d0f2-95f4-4a07-af54-0e15d4ce58a6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:19.691038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948d0f2-95f4-4a07-af54-0e15d4ce58a6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:19.691371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1948d0f2-95f4-4a07-af54-0e15d4ce58a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:19.711170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1948d0f2-95f4-4a07-af54-0e15d4ce58a6 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:19.712369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1948d0f2-95f4-4a07-af54-0e15d4ce58a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:19.722161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1138/2247] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:39:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:19.726863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d47e6f-ee49-487c-953e-7c28e51ea14b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:19.737280 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d47e6f-ee49-487c-953e-7c28e51ea14b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:19.742572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d5e607-28fe-4e3a-be83-47d54e479e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:19.748632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e607-28fe-4e3a-be83-47d54e479e9b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:19.748632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e607-28fe-4e3a-be83-47d54e479e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:19.748632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d5e607-28fe-4e3a-be83-47d54e479e9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:19.748632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5e607-28fe-4e3a-be83-47d54e479e9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:39:19.748632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5e607-28fe-4e3a-be83-47d54e479e9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:19.748632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d5e607-28fe-4e3a-be83-47d54e479e9b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:19.760380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1110/2248] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:39:19.764388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948d0f2-95f4-4a07-af54-0e15d4ce58a6 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:19.776619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1948d0f2-95f4-4a07-af54-0e15d4ce58a6 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:19.781841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48ca02-22ea-4fd7-9d61-9cf89cd2d463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:19.782562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48ca02-22ea-4fd7-9d61-9cf89cd2d463 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:19.785486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48ca02-22ea-4fd7-9d61-9cf89cd2d463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:19.785486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48ca02-22ea-4fd7-9d61-9cf89cd2d463 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:19.785486 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48ca02-22ea-4fd7-9d61-9cf89cd2d463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:19.785915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48ca02-22ea-4fd7-9d61-9cf89cd2d463 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:19.799653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:19.917258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0cf5a-1701-48a2-b867-c25402a67674 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:19.917258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0cf5a-1701-48a2-b867-c25402a67674 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:19.917258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0cf5a-1701-48a2-b867-c25402a67674 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:19.918628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1111/2249] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:39:19.924299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e1e0-5c4c-46c3-92a8-155f39dd4410 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:19.924665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e1e0-5c4c-46c3-92a8-155f39dd4410 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:19.924951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01e1e0-5c4c-46c3-92a8-155f39dd4410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:19.953347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1139/2250] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:39:19 2022] POST /identity/v3/projects => generated 373 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:39:19.959655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48ca02-22ea-4fd7-9d61-9cf89cd2d463 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:19.978780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-fa01e1e0-5c4c-46c3-92a8-155f39dd4410 None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:19.979993 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fa01e1e0-5c4c-46c3-92a8-155f39dd4410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:20.029381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48ca02-22ea-4fd7-9d61-9cf89cd2d463 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:20.034251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473bb8e-5c04-4f8b-b29c-c139dccb960a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:20.034932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473bb8e-5c04-4f8b-b29c-c139dccb960a admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.035214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473bb8e-5c04-4f8b-b29c-c139dccb960a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.035497 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c473bb8e-5c04-4f8b-b29c-c139dccb960a admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.036380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473bb8e-5c04-4f8b-b29c-c139dccb960a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:20.038831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c473bb8e-5c04-4f8b-b29c-c139dccb960a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:20.060925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1112/2251] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:39:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:20.073978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e1e0-5c4c-46c3-92a8-155f39dd4410 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:20.075391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fa01e1e0-5c4c-46c3-92a8-155f39dd4410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:20.087797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:20.156014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01e1e0-5c4c-46c3-92a8-155f39dd4410 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:20.160088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee5b90-fe48-4f33-b861-29d3ce329cb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451754f5553e4b9783b4e75f6d408ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:20.161614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee5b90-fe48-4f33-b861-29d3ce329cb8 service glance] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.164852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee5b90-fe48-4f33-b861-29d3ce329cb8 service glance] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.164852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee5b90-fe48-4f33-b861-29d3ce329cb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.178336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee5b90-fe48-4f33-b861-29d3ce329cb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:20.179793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddee5b90-fe48-4f33-b861-29d3ce329cb8 service glance] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:20.193596 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1113/2252] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:39:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:39:20.208238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1140/2253] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:39:19 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:39:20.213085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee5b90-fe48-4f33-b861-29d3ce329cb8 service glance] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:20.222970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee5b90-fe48-4f33-b861-29d3ce329cb8 service glance] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:20.228997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4475d-543f-49f6-b726-d41bb76151c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:20.229658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4475d-543f-49f6-b726-d41bb76151c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.229945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4475d-543f-49f6-b726-d41bb76151c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.230225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4475d-543f-49f6-b726-d41bb76151c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.230948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4475d-543f-49f6-b726-d41bb76151c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:20.232608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4475d-543f-49f6-b726-d41bb76151c6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:20.243796 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1114/2254] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:39:20.257075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473bb8e-5c04-4f8b-b29c-c139dccb960a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:20.267153 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c473bb8e-5c04-4f8b-b29c-c139dccb960a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:20.272309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84ff8d-5651-492e-96c1-93277a5b5159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:20.273058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ff8d-5651-492e-96c1-93277a5b5159 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.273340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ff8d-5651-492e-96c1-93277a5b5159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.273616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84ff8d-5651-492e-96c1-93277a5b5159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.274333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84ff8d-5651-492e-96c1-93277a5b5159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:20.275935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84ff8d-5651-492e-96c1-93277a5b5159 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:20.291864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1141/2255] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:39:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:39:20.293064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4475d-543f-49f6-b726-d41bb76151c6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:20.303599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4475d-543f-49f6-b726-d41bb76151c6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:20.308332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4197161e-77de-4dbb-81a3-5c2b15ea646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:20.309328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197161e-77de-4dbb-81a3-5c2b15ea646d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.309618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197161e-77de-4dbb-81a3-5c2b15ea646d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.309937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197161e-77de-4dbb-81a3-5c2b15ea646d admin admin] PATH_INFO: `/v3/projects/f13c4f9ee9c444d9b9a0d2c2e3ec9142/users/f3cd1d48ead14854a5f9f532efcc1e62/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.327665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197161e-77de-4dbb-81a3-5c2b15ea646d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f13c4f9ee9c444d9b9a0d2c2e3ec9142, user_id=f3cd1d48ead14854a5f9f532efcc1e62, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:20.335698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4197161e-77de-4dbb-81a3-5c2b15ea646d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:20.451450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1115/2256] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:39:20 2022] PUT /identity/v3/projects/f13c4f9ee9c444d9b9a0d2c2e3ec9142/users/f3cd1d48ead14854a5f9f532efcc1e62/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:39:20.467334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eea76-7efb-4eeb-8082-1c12103f5f5f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.467334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eea76-7efb-4eeb-8082-1c12103f5f5f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.467334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315eea76-7efb-4eeb-8082-1c12103f5f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.475595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-315eea76-7efb-4eeb-8082-1c12103f5f5f None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:20.477084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-315eea76-7efb-4eeb-8082-1c12103f5f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:20.495581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec5980-eef4-4d53-be29-be811c8ec9d2 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.495911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec5980-eef4-4d53-be29-be811c8ec9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.496191 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec5980-eef4-4d53-be29-be811c8ec9d2 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.497595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1116/2257] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:39:20.502935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecd03-f6d7-4651-a5be-b39d4b0e82d3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.503220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecd03-f6d7-4651-a5be-b39d4b0e82d3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.503496 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aecd03-f6d7-4651-a5be-b39d4b0e82d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.522782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f9aecd03-f6d7-4651-a5be-b39d4b0e82d3 None None] MFA Rules not processed for user `a5f94913ac8a463db617fbe30df395b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:20.524687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f9aecd03-f6d7-4651-a5be-b39d4b0e82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:20.542047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1142/2258] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:39:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:20.552651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eea76-7efb-4eeb-8082-1c12103f5f5f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:20.554040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-315eea76-7efb-4eeb-8082-1c12103f5f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:20.585024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1117/2259] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:39:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:20.600146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aecd03-f6d7-4651-a5be-b39d4b0e82d3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:20.601584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f9aecd03-f6d7-4651-a5be-b39d4b0e82d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:20.612103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aecd03-f6d7-4651-a5be-b39d4b0e82d3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:20.616707 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9679584-1f18-4f49-9225-1c0d104b8e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:20.617352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679584-1f18-4f49-9225-1c0d104b8e98 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.617637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679584-1f18-4f49-9225-1c0d104b8e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.617912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9679584-1f18-4f49-9225-1c0d104b8e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.623300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315eea76-7efb-4eeb-8082-1c12103f5f5f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:20.625212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9679584-1f18-4f49-9225-1c0d104b8e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:20.626634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9679584-1f18-4f49-9225-1c0d104b8e98 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:20.627010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a832d9d5-285f-4660-a98f-36e4b45f21b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:20.627648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832d9d5-285f-4660-a98f-36e4b45f21b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.627932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832d9d5-285f-4660-a98f-36e4b45f21b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.628249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a832d9d5-285f-4660-a98f-36e4b45f21b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.636205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1118/2260] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:39:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:39:20.639222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832d9d5-285f-4660-a98f-36e4b45f21b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:20.640715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a832d9d5-285f-4660-a98f-36e4b45f21b0 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:20.652042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1143/2261] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:39:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:39:20.738016 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7f9a5-85a3-4f65-9d7e-1210bee774a1 None None] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.738306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7f9a5-85a3-4f65-9d7e-1210bee774a1 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.738588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a7f9a5-85a3-4f65-9d7e-1210bee774a1 None None] PATH_INFO: `/` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.740553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1119/2262] 10.222.0.24 () {54 vars in 921 bytes} [Wed May 25 07:39:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:39:20.746490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef8c38-cdeb-43e4-ace5-a2a57d96ccf7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.746833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef8c38-cdeb-43e4-ace5-a2a57d96ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.747097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef8c38-cdeb-43e4-ace5-a2a57d96ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.766368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6bef8c38-cdeb-43e4-ace5-a2a57d96ccf7 None None] MFA Rules not processed for user `3a06a84967694e68a3a77bf29f16ee3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:20.767609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6bef8c38-cdeb-43e4-ace5-a2a57d96ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:20.779740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:20.840555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1144/2263] 10.222.0.24 () {58 vars in 1018 bytes} [Wed May 25 07:39:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:20.852984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7f9a5-85a3-4f65-9d7e-1210bee774a1 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:20.854865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-84a7f9a5-85a3-4f65-9d7e-1210bee774a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:20.870097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a7f9a5-85a3-4f65-9d7e-1210bee774a1 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:20.875040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a562a2-c04b-41ef-9574-96280b6c5e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:20.875709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a562a2-c04b-41ef-9574-96280b6c5e50 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:20.875992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a562a2-c04b-41ef-9574-96280b6c5e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:20.876271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a562a2-c04b-41ef-9574-96280b6c5e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:20.887622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a562a2-c04b-41ef-9574-96280b6c5e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:20.889103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a562a2-c04b-41ef-9574-96280b6c5e50 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:20.900419 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1120/2264] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:39:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:39:25.518717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a074e16-4caa-426e-81a0-0c06ed36ad4c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:25.519280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a074e16-4caa-426e-81a0-0c06ed36ad4c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:25.519470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a074e16-4caa-426e-81a0-0c06ed36ad4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:25.540080 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4a074e16-4caa-426e-81a0-0c06ed36ad4c None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:25.541441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4a074e16-4caa-426e-81a0-0c06ed36ad4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:25.632760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1145/2265] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:39:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:25.647625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a562a2-c04b-41ef-9574-96280b6c5e50 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:25.649275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b4a562a2-c04b-41ef-9574-96280b6c5e50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:25.702510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:25.749552 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a562a2-c04b-41ef-9574-96280b6c5e50 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:25.756733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a5c1-382f-45e2-84e5-be219b607076 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:25.757421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a5c1-382f-45e2-84e5-be219b607076 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:25.757773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a5c1-382f-45e2-84e5-be219b607076 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:25.758142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a50a5c1-382f-45e2-84e5-be219b607076 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:25.772034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50a5c1-382f-45e2-84e5-be219b607076 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:25.773824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a50a5c1-382f-45e2-84e5-be219b607076 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:25.786807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1121/2266] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:39:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:39:27.207449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44edc-08ae-4893-ba95-20f527a9a7bd None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:27.209828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44edc-08ae-4893-ba95-20f527a9a7bd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:27.209828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a44edc-08ae-4893-ba95-20f527a9a7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:27.276677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d8a44edc-08ae-4893-ba95-20f527a9a7bd None None] MFA Rules not processed for user `f3cd1d48ead14854a5f9f532efcc1e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:27.277932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d8a44edc-08ae-4893-ba95-20f527a9a7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:27.406756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1146/2267] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:39:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:27.410205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a5c1-382f-45e2-84e5-be219b607076 service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:27.433529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a50a5c1-382f-45e2-84e5-be219b607076 service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:27.450249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2ad45-5838-4952-9f92-ca63146a40ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:27.454526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2ad45-5838-4952-9f92-ca63146a40ab admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:27.454526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2ad45-5838-4952-9f92-ca63146a40ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:27.454526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd2ad45-5838-4952-9f92-ca63146a40ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:27.454526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2ad45-5838-4952-9f92-ca63146a40ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:27.454526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd2ad45-5838-4952-9f92-ca63146a40ab admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:27.538917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1122/2268] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:39:27 2022] POST /identity/v3/projects => generated 373 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:39:27.542944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44edc-08ae-4893-ba95-20f527a9a7bd None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:27.558327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a44edc-08ae-4893-ba95-20f527a9a7bd None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:27.615094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:27.636118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddf9b5-0351-49dc-8cd3-22d9fdfd4d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:27.636752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf9b5-0351-49dc-8cd3-22d9fdfd4d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:27.637034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf9b5-0351-49dc-8cd3-22d9fdfd4d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:27.637365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddf9b5-0351-49dc-8cd3-22d9fdfd4d05 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:27.638118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddf9b5-0351-49dc-8cd3-22d9fdfd4d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:27.641021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beddf9b5-0351-49dc-8cd3-22d9fdfd4d05 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:27.729865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1147/2269] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:39:27 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:39:27.731236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2ad45-5838-4952-9f92-ca63146a40ab admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:27.743826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd2ad45-5838-4952-9f92-ca63146a40ab admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:27.748544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87045c05-cda9-454c-add9-d1053df8dd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:27.749262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87045c05-cda9-454c-add9-d1053df8dd3b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:27.749551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87045c05-cda9-454c-add9-d1053df8dd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:27.749870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87045c05-cda9-454c-add9-d1053df8dd3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:27.750636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87045c05-cda9-454c-add9-d1053df8dd3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:27.752723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87045c05-cda9-454c-add9-d1053df8dd3b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:27.766909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1123/2270] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:39:27.771692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddf9b5-0351-49dc-8cd3-22d9fdfd4d05 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:27.788536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beddf9b5-0351-49dc-8cd3-22d9fdfd4d05 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:27.799871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d06db2-1a1d-4b8b-be13-a7aa09391484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:27.801149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d06db2-1a1d-4b8b-be13-a7aa09391484 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:27.801754 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d06db2-1a1d-4b8b-be13-a7aa09391484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:27.802653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d06db2-1a1d-4b8b-be13-a7aa09391484 admin admin] PATH_INFO: `/v3/projects/21d0ab14c2cb4b7ab6bd84d2407011e7/users/83c595d1850240e99408c00c5e92c8d3/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:27.840984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d06db2-1a1d-4b8b-be13-a7aa09391484 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d0ab14c2cb4b7ab6bd84d2407011e7, user_id=83c595d1850240e99408c00c5e92c8d3, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:27.851250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d06db2-1a1d-4b8b-be13-a7aa09391484 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:27.925253 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1148/2271] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:39:27 2022] PUT /identity/v3/projects/21d0ab14c2cb4b7ab6bd84d2407011e7/users/83c595d1850240e99408c00c5e92c8d3/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:39:27.929383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87045c05-cda9-454c-add9-d1053df8dd3b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:27.940515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87045c05-cda9-454c-add9-d1053df8dd3b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:28.026654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d1a55-ae9b-4a55-9fe6-068720e2fa41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:28.027359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d1a55-ae9b-4a55-9fe6-068720e2fa41 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:28.027659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d1a55-ae9b-4a55-9fe6-068720e2fa41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:28.027928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d1a55-ae9b-4a55-9fe6-068720e2fa41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:28.028706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d1a55-ae9b-4a55-9fe6-068720e2fa41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:28.030358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d1a55-ae9b-4a55-9fe6-068720e2fa41 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:28.044876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1124/2272] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:39:27 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:39:28.046096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d06db2-1a1d-4b8b-be13-a7aa09391484 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:28.062017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d06db2-1a1d-4b8b-be13-a7aa09391484 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:28.070449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325a34f-1209-4fd2-9cb1-ab8e0b55cb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:28.072504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a34f-1209-4fd2-9cb1-ab8e0b55cb95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:28.072504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a34f-1209-4fd2-9cb1-ab8e0b55cb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:28.072504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325a34f-1209-4fd2-9cb1-ab8e0b55cb95 admin admin] PATH_INFO: `/v3/projects/21d0ab14c2cb4b7ab6bd84d2407011e7/users/83c595d1850240e99408c00c5e92c8d3/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:28.074093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325a34f-1209-4fd2-9cb1-ab8e0b55cb95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d0ab14c2cb4b7ab6bd84d2407011e7, user_id=83c595d1850240e99408c00c5e92c8d3, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:28.076804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2325a34f-1209-4fd2-9cb1-ab8e0b55cb95 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:28.088901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1149/2273] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:39:28 2022] PUT /identity/v3/projects/21d0ab14c2cb4b7ab6bd84d2407011e7/users/83c595d1850240e99408c00c5e92c8d3/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:39:36.997806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173961-80cc-436a-ba74-bf52d010e893 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:36.998333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173961-80cc-436a-ba74-bf52d010e893 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:36.998434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e173961-80cc-436a-ba74-bf52d010e893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:37.061239 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1e173961-80cc-436a-ba74-bf52d010e893 None None] MFA Rules not processed for user `83c595d1850240e99408c00c5e92c8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:37.063389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1e173961-80cc-436a-ba74-bf52d010e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:37.148898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1125/2274] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:39:36 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:37.162361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325a34f-1209-4fd2-9cb1-ab8e0b55cb95 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:37.164723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2325a34f-1209-4fd2-9cb1-ab8e0b55cb95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:37.242335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2325a34f-1209-4fd2-9cb1-ab8e0b55cb95 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:37.247829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e49eba-3079-4aa9-9b1d-d8c8c7525e11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:37.250990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49eba-3079-4aa9-9b1d-d8c8c7525e11 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:37.250990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49eba-3079-4aa9-9b1d-d8c8c7525e11 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:37.250990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e49eba-3079-4aa9-9b1d-d8c8c7525e11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:37.307990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e49eba-3079-4aa9-9b1d-d8c8c7525e11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:37.309675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e49eba-3079-4aa9-9b1d-d8c8c7525e11 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:37.319666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1150/2275] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:39:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:39:38.542337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e173961-80cc-436a-ba74-bf52d010e893 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:38.545197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1e173961-80cc-436a-ba74-bf52d010e893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:38.563107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:38.637051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e173961-80cc-436a-ba74-bf52d010e893 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:38.644935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:38.646237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:38.646675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:38.646959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:38.650394 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:38.667010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:38.668719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:38.679490 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1126/2276] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:39:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:39:40.237287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f3e42-bd12-4c24-9d9a-324e271d339d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:40.237766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f3e42-bd12-4c24-9d9a-324e271d339d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:40.237864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f3e42-bd12-4c24-9d9a-324e271d339d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:40.266307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-333f3e42-bd12-4c24-9d9a-324e271d339d None None] MFA Rules not processed for user `f3cd1d48ead14854a5f9f532efcc1e62`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:40.267786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-333f3e42-bd12-4c24-9d9a-324e271d339d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:40.276411 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1151/2277] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:39:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:43.222130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:43.224397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:43.293790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7f2e2-fbbd-43c6-a0dd-4262b2e2c9f2 service placement] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:43.304718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:43.305703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:43.306143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:43.306483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] PATH_INFO: `/v3/users/7f4e8b5acca64d35b3ae6bf5b5333428` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:43.308156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f4e8b5acca64d35b3ae6bf5b5333428)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:43.310533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:43.494339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f4e8b5acca64d35b3ae6bf5b5333428'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:43.501310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f4e8b5acca64d35b3ae6bf5b5333428'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:43.502421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f4e8b5acca64d35b3ae6bf5b5333428'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:43.514564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f4e8b5acca64d35b3ae6bf5b5333428'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:43.515226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f4e8b5acca64d35b3ae6bf5b5333428'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:43.605710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1127/2278] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:39:43 2022] DELETE /identity/v3/users/7f4e8b5acca64d35b3ae6bf5b5333428 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:39:43.610360 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f408702-d87e-4b9a-84cf-fef2a32fcb74 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:43.610862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f408702-d87e-4b9a-84cf-fef2a32fcb74 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:43.611119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f408702-d87e-4b9a-84cf-fef2a32fcb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:43.631043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5f408702-d87e-4b9a-84cf-fef2a32fcb74 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:43.632438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5f408702-d87e-4b9a-84cf-fef2a32fcb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:43.653014 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:43.695306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1152/2279] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:43.705419 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:43.706924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:43.728096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:43.769928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b385c80-45d6-4c30-b838-057a9042af6f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:43.774023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba42f0b2-2849-49d2-be07-ca44310b6759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:43.774664 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42f0b2-2849-49d2-be07-ca44310b6759 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:43.774948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42f0b2-2849-49d2-be07-ca44310b6759 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:43.775225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba42f0b2-2849-49d2-be07-ca44310b6759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:43.784092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42f0b2-2849-49d2-be07-ca44310b6759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:43.785641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba42f0b2-2849-49d2-be07-ca44310b6759 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:43.795439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1128/2280] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:39:44.373545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f408702-d87e-4b9a-84cf-fef2a32fcb74 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:44.375016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5f408702-d87e-4b9a-84cf-fef2a32fcb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:44.388640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f408702-d87e-4b9a-84cf-fef2a32fcb74 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:44.393515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:44.394403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:44.394663 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:44.394936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] PATH_INFO: `/v3/projects/6467b70f536148c596f4b6bef109f1a2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:44.396485 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6467b70f536148c596f4b6bef109f1a2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:44.398500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:44.528179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6467b70f536148c596f4b6bef109f1a2', 'request_id': 'req-a4672f33-36dc-4b51-b277-168d46b19803'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:44.534949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6467b70f536148c596f4b6bef109f1a2', 'request_id': 'req-a4672f33-36dc-4b51-b277-168d46b19803'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:44.541580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6467b70f536148c596f4b6bef109f1a2', 'request_id': 'req-a4672f33-36dc-4b51-b277-168d46b19803'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:44.622330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] The token cache is being invalidate because project 6467b70f536148c596f4b6bef109f1a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:39:44.622925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:44.623252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:39:44.624815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1153/2281] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:39:44 2022] DELETE /identity/v3/projects/6467b70f536148c596f4b6bef109f1a2 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:39:50.685512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5e2f8-60ee-43b4-9b99-b2173e80248b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:50.686036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5e2f8-60ee-43b4-9b99-b2173e80248b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:50.686247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5e2f8-60ee-43b4-9b99-b2173e80248b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:50.704635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-83f5e2f8-60ee-43b4-9b99-b2173e80248b None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:39:50.705948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-83f5e2f8-60ee-43b4-9b99-b2173e80248b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:50.770572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1129/2282] 10.222.0.24 () {58 vars in 967 bytes} [Wed May 25 07:39:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:39:50.783900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:39:50.784529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:39:50.859610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4672f33-36dc-4b51-b277-168d46b19803 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:39:50.864933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abe234-37bf-4424-bdc3-e639427732e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:39:50.866243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abe234-37bf-4424-bdc3-e639427732e2 service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:39:50.866886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abe234-37bf-4424-bdc3-e639427732e2 service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:39:50.867266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abe234-37bf-4424-bdc3-e639427732e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:39:50.876503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abe234-37bf-4424-bdc3-e639427732e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:39:50.878128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abe234-37bf-4424-bdc3-e639427732e2 service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:39:50.889064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1154/2283] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:39:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:40:00.764056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=44 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:00.885672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:07.283932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee670-0a79-4823-acfe-8538f2343c6d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:40:07.284471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee670-0a79-4823-acfe-8538f2343c6d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:40:07.284471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fee670-0a79-4823-acfe-8538f2343c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:40:07.303242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-36fee670-0a79-4823-acfe-8538f2343c6d None None] MFA Rules not processed for user `f90f0f6afda54e80bc319dc5bdb80ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:40:07.304466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-36fee670-0a79-4823-acfe-8538f2343c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:40:07.367778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1130/2284] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:40:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:40:11.843723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968e374-67be-41f5-bae8-8301efdfbc78 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:40:11.844725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968e374-67be-41f5-bae8-8301efdfbc78 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:40:11.845012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1968e374-67be-41f5-bae8-8301efdfbc78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:40:11.864836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1968e374-67be-41f5-bae8-8301efdfbc78 None None] MFA Rules not processed for user `0487ea9076ee4baf8138fdc25ce02522`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:40:11.866083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1968e374-67be-41f5-bae8-8301efdfbc78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:40:11.933425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1155/2285] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:40:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:40:17.359687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=25 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:21.922384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=25 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:22.807325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fee670-0a79-4823-acfe-8538f2343c6d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:40:22.808799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-36fee670-0a79-4823-acfe-8538f2343c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:40:22.867990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fee670-0a79-4823-acfe-8538f2343c6d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:40:22.871672 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609db932-fada-4707-9206-6f6cf38c9b1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:40:22.872308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db932-fada-4707-9206-6f6cf38c9b1f service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:40:22.872623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db932-fada-4707-9206-6f6cf38c9b1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:40:22.872901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609db932-fada-4707-9206-6f6cf38c9b1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:40:22.874685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-609db932-fada-4707-9206-6f6cf38c9b1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:40:22.935315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609db932-fada-4707-9206-6f6cf38c9b1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:40:22.936765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609db932-fada-4707-9206-6f6cf38c9b1f service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:40:22.946626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1131/2286] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:40:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:40:32.941840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=50 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:43.671722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519aba1-f22f-463f-a834-aafd955341c5 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:40:43.672185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519aba1-f22f-463f-a834-aafd955341c5 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:40:43.672297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d519aba1-f22f-463f-a834-aafd955341c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:40:43.691517 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d519aba1-f22f-463f-a834-aafd955341c5 None None] MFA Rules not processed for user `18eb8b615526451498d3adc382d5a410`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:40:43.692755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d519aba1-f22f-463f-a834-aafd955341c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:40:43.753143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1156/2287] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:40:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:40:53.746326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=25 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:12.510891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de2667-702c-4bde-b595-3463ae6e7ab6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:12.513379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de2667-702c-4bde-b595-3463ae6e7ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:12.513379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67de2667-702c-4bde-b595-3463ae6e7ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:12.529726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-67de2667-702c-4bde-b595-3463ae6e7ab6 None None] MFA Rules not processed for user `28d83ef95cda448dbd72acbd13a5f008`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:12.530999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-67de2667-702c-4bde-b595-3463ae6e7ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:12.588437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1132/2288] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:20.666332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519aba1-f22f-463f-a834-aafd955341c5 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:20.667801 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d519aba1-f22f-463f-a834-aafd955341c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:20.734144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d519aba1-f22f-463f-a834-aafd955341c5 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:20.739168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:20.740037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:20.740314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:20.740618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] PATH_INFO: `/v3/users/f90f0f6afda54e80bc319dc5bdb80ea6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:20.741833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=f90f0f6afda54e80bc319dc5bdb80ea6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:20.743811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:20.960102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f90f0f6afda54e80bc319dc5bdb80ea6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:20.972253 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f90f0f6afda54e80bc319dc5bdb80ea6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:21.088823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f90f0f6afda54e80bc319dc5bdb80ea6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:21.089501 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f90f0f6afda54e80bc319dc5bdb80ea6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:21.090099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4b1b4674-6525-4004-88ef-c3224b9e48ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f90f0f6afda54e80bc319dc5bdb80ea6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:21.102997 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1157/2289] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:41:20 2022] DELETE /identity/v3/users/f90f0f6afda54e80bc319dc5bdb80ea6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:21.402069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de2667-702c-4bde-b595-3463ae6e7ab6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:21.413839 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67de2667-702c-4bde-b595-3463ae6e7ab6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:21.472370 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:21.473243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:21.473522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:21.473793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] PATH_INFO: `/v3/projects/d4719a4804e24f27b9427e58c5cbe13b` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:21.474994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4719a4804e24f27b9427e58c5cbe13b)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:21.477818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:21.625758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4719a4804e24f27b9427e58c5cbe13b', 'request_id': 'req-7538c36f-700e-440d-81d7-e1c5e9915d61'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:21.631979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4719a4804e24f27b9427e58c5cbe13b', 'request_id': 'req-7538c36f-700e-440d-81d7-e1c5e9915d61'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:21.637445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4719a4804e24f27b9427e58c5cbe13b', 'request_id': 'req-7538c36f-700e-440d-81d7-e1c5e9915d61'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:21.716904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] The token cache is being invalidate because project d4719a4804e24f27b9427e58c5cbe13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:41:21.717210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:21.717880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7538c36f-700e-440d-81d7-e1c5e9915d61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:21.719524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1133/2290] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:41:21 2022] DELETE /identity/v3/projects/d4719a4804e24f27b9427e58c5cbe13b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:21.731623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84e3f-63d3-4c13-b1d5-87fcc7949a19 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:21.731623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84e3f-63d3-4c13-b1d5-87fcc7949a19 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:21.731623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad84e3f-63d3-4c13-b1d5-87fcc7949a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:21.743077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1ad84e3f-63d3-4c13-b1d5-87fcc7949a19 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:21.744254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1ad84e3f-63d3-4c13-b1d5-87fcc7949a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:21.803316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1158/2291] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:41:21.810926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23856633-6e6c-409a-b9cb-8825bd8b2895 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:21.811212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23856633-6e6c-409a-b9cb-8825bd8b2895 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:21.811488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23856633-6e6c-409a-b9cb-8825bd8b2895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:21.830381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-23856633-6e6c-409a-b9cb-8825bd8b2895 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:21.831578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-23856633-6e6c-409a-b9cb-8825bd8b2895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:21.840302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1134/2292] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:21.844374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84e3f-63d3-4c13-b1d5-87fcc7949a19 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:21.854504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad84e3f-63d3-4c13-b1d5-87fcc7949a19 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:21.859067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764a234-b696-47a8-914e-a4c3553b5b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:21.859718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764a234-b696-47a8-914e-a4c3553b5b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:21.859999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764a234-b696-47a8-914e-a4c3553b5b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:21.860273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9764a234-b696-47a8-914e-a4c3553b5b25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:21.861025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764a234-b696-47a8-914e-a4c3553b5b25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:41:21.861598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764a234-b696-47a8-914e-a4c3553b5b25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:21.863203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9764a234-b696-47a8-914e-a4c3553b5b25 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:21.874446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1159/2293] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:41:21.878742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23856633-6e6c-409a-b9cb-8825bd8b2895 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:21.887871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23856633-6e6c-409a-b9cb-8825bd8b2895 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:21.892547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df35a61-7b12-4df7-a56c-078bd55c1587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:21.893189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df35a61-7b12-4df7-a56c-078bd55c1587 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:21.893467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df35a61-7b12-4df7-a56c-078bd55c1587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:21.893736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df35a61-7b12-4df7-a56c-078bd55c1587 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:21.894429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df35a61-7b12-4df7-a56c-078bd55c1587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:21.896303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df35a61-7b12-4df7-a56c-078bd55c1587 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:22.010738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1135/2294] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:41:21 2022] POST /identity/v3/projects => generated 405 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:41:22.014733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764a234-b696-47a8-914e-a4c3553b5b25 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:22.025373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9764a234-b696-47a8-914e-a4c3553b5b25 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:22.029104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:22.081328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346351-1e68-48fe-9cc0-afd3eef97ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:22.082002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346351-1e68-48fe-9cc0-afd3eef97ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:22.082285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346351-1e68-48fe-9cc0-afd3eef97ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:22.082560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16346351-1e68-48fe-9cc0-afd3eef97ea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:22.083242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16346351-1e68-48fe-9cc0-afd3eef97ea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:22.085871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16346351-1e68-48fe-9cc0-afd3eef97ea0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:22.285851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1160/2295] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:41:22 2022] POST /identity/v3/users => generated 303 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:41:22.289948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df35a61-7b12-4df7-a56c-078bd55c1587 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:22.300245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df35a61-7b12-4df7-a56c-078bd55c1587 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:22.305332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2e9fe-55e5-4132-abdd-5ffefc2d74e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:22.305990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2e9fe-55e5-4132-abdd-5ffefc2d74e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:22.306275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2e9fe-55e5-4132-abdd-5ffefc2d74e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:22.306551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a2e9fe-55e5-4132-abdd-5ffefc2d74e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:22.307279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2e9fe-55e5-4132-abdd-5ffefc2d74e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:22.308910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a2e9fe-55e5-4132-abdd-5ffefc2d74e1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:22.310152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:22.320714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1136/2296] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:22.324418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346351-1e68-48fe-9cc0-afd3eef97ea0 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:22.334327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16346351-1e68-48fe-9cc0-afd3eef97ea0 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:22.338965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5112e5-f8ca-4bec-a019-7bd9a09debc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:22.339615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5112e5-f8ca-4bec-a019-7bd9a09debc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:22.339897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5112e5-f8ca-4bec-a019-7bd9a09debc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:22.340500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5112e5-f8ca-4bec-a019-7bd9a09debc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:22.341000 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5112e5-f8ca-4bec-a019-7bd9a09debc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:22.342597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5112e5-f8ca-4bec-a019-7bd9a09debc2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:22.352752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1161/2297] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:22.356889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2e9fe-55e5-4132-abdd-5ffefc2d74e1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:22.367697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a2e9fe-55e5-4132-abdd-5ffefc2d74e1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:22.372499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70e7b-28c7-4706-a9ce-c7c816979269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:22.373476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70e7b-28c7-4706-a9ce-c7c816979269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:22.373756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70e7b-28c7-4706-a9ce-c7c816979269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:22.374025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b70e7b-28c7-4706-a9ce-c7c816979269 admin admin] PATH_INFO: `/v3/projects/a7f8cad467754a41870947a4d7981cd8/users/ddc80fcfb1b34ebaae233f926604d2b6/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:22.390007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b70e7b-28c7-4706-a9ce-c7c816979269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7f8cad467754a41870947a4d7981cd8, user_id=ddc80fcfb1b34ebaae233f926604d2b6, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:22.392688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b70e7b-28c7-4706-a9ce-c7c816979269 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:22.483581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1137/2298] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:41:22 2022] PUT /identity/v3/projects/a7f8cad467754a41870947a4d7981cd8/users/ddc80fcfb1b34ebaae233f926604d2b6/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:22.488939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c4baa-f8e5-4adf-af10-86df70ce4745 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:22.489256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c4baa-f8e5-4adf-af10-86df70ce4745 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:22.489532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c4baa-f8e5-4adf-af10-86df70ce4745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:22.508879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-343c4baa-f8e5-4adf-af10-86df70ce4745 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:22.510079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-343c4baa-f8e5-4adf-af10-86df70ce4745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:22.566847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1162/2299] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:22.576838 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70e7b-28c7-4706-a9ce-c7c816979269 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:22.578496 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e2b70e7b-28c7-4706-a9ce-c7c816979269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:22.636975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b70e7b-28c7-4706-a9ce-c7c816979269 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:22.640854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4801-b2e9-43f4-ab37-5e0b69d9f56b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:22.641497 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4801-b2e9-43f4-ab37-5e0b69d9f56b service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:22.641810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4801-b2e9-43f4-ab37-5e0b69d9f56b service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:22.642086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4801-b2e9-43f4-ab37-5e0b69d9f56b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:22.651444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4801-b2e9-43f4-ab37-5e0b69d9f56b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:22.652913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4801-b2e9-43f4-ab37-5e0b69d9f56b service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:22.662684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1138/2300] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:41:24.043391 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717307a-c30c-46ba-a1af-82459e38cf13 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:24.043903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717307a-c30c-46ba-a1af-82459e38cf13 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:24.044034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3717307a-c30c-46ba-a1af-82459e38cf13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:24.071429 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3717307a-c30c-46ba-a1af-82459e38cf13 None None] MFA Rules not processed for user `ddc80fcfb1b34ebaae233f926604d2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:24.072666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3717307a-c30c-46ba-a1af-82459e38cf13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:24.143209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1163/2301] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:24 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:24.148360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4801-b2e9-43f4-ab37-5e0b69d9f56b service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:24.158401 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4801-b2e9-43f4-ab37-5e0b69d9f56b service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:24.163998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363343f5-6e21-4b48-83fb-22431584babf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:24.164919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363343f5-6e21-4b48-83fb-22431584babf admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:24.165210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363343f5-6e21-4b48-83fb-22431584babf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:24.165491 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363343f5-6e21-4b48-83fb-22431584babf admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:24.166191 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363343f5-6e21-4b48-83fb-22431584babf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:24.168092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363343f5-6e21-4b48-83fb-22431584babf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:24.310373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1139/2302] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:41:24 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:41:24.314422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717307a-c30c-46ba-a1af-82459e38cf13 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:24.325988 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3717307a-c30c-46ba-a1af-82459e38cf13 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:24.338188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:24.382454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f911-ed1a-4070-a066-aa01302fc4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:24.383177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f911-ed1a-4070-a066-aa01302fc4e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:24.383607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f911-ed1a-4070-a066-aa01302fc4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:24.383888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6489f911-ed1a-4070-a066-aa01302fc4e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:24.384607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489f911-ed1a-4070-a066-aa01302fc4e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:24.386553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6489f911-ed1a-4070-a066-aa01302fc4e2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:24.548986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1164/2303] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:41:24 2022] POST /identity/v3/users => generated 308 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:41:24.552850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363343f5-6e21-4b48-83fb-22431584babf admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:24.564064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363343f5-6e21-4b48-83fb-22431584babf admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:24.568658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d8e86-a809-4ab4-b307-10365123376a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:24.569317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d8e86-a809-4ab4-b307-10365123376a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:24.570203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d8e86-a809-4ab4-b307-10365123376a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:24.570483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d8e86-a809-4ab4-b307-10365123376a admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:24.571206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d8e86-a809-4ab4-b307-10365123376a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:24.572835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d8e86-a809-4ab4-b307-10365123376a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:24.583538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1140/2304] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:24.588454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f911-ed1a-4070-a066-aa01302fc4e2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:24.598751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6489f911-ed1a-4070-a066-aa01302fc4e2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:24.603549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6c98d-410a-43c7-b456-a7ec3a15f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:24.604427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6c98d-410a-43c7-b456-a7ec3a15f1e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:24.604744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6c98d-410a-43c7-b456-a7ec3a15f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:24.605016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6c98d-410a-43c7-b456-a7ec3a15f1e2 admin admin] PATH_INFO: `/v3/projects/c2aba48947ba41c69424c0bffacf791f/users/ccce9b53094a4a33a638165eb5571313/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:24.620314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6c98d-410a-43c7-b456-a7ec3a15f1e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2aba48947ba41c69424c0bffacf791f, user_id=ccce9b53094a4a33a638165eb5571313, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:24.622995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc6c98d-410a-43c7-b456-a7ec3a15f1e2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:24.771535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1165/2305] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:41:24 2022] PUT /identity/v3/projects/c2aba48947ba41c69424c0bffacf791f/users/ccce9b53094a4a33a638165eb5571313/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:24.775617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d8e86-a809-4ab4-b307-10365123376a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:24.786049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d8e86-a809-4ab4-b307-10365123376a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:24.842973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c646f9a0-1c3b-42ae-90ab-77f8133f6d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:24.843568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646f9a0-1c3b-42ae-90ab-77f8133f6d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:24.843857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646f9a0-1c3b-42ae-90ab-77f8133f6d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:24.844133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c646f9a0-1c3b-42ae-90ab-77f8133f6d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:24.845006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646f9a0-1c3b-42ae-90ab-77f8133f6d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:24.846599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c646f9a0-1c3b-42ae-90ab-77f8133f6d77 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:24.856403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1141/2306] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:41:24.860740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6c98d-410a-43c7-b456-a7ec3a15f1e2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:24.871887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc6c98d-410a-43c7-b456-a7ec3a15f1e2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:24.876534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b879f-6e7a-4644-80cc-6ef49bca8b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:24.877417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b879f-6e7a-4644-80cc-6ef49bca8b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:24.877700 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b879f-6e7a-4644-80cc-6ef49bca8b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:24.877976 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b879f-6e7a-4644-80cc-6ef49bca8b72 admin admin] PATH_INFO: `/v3/projects/c2aba48947ba41c69424c0bffacf791f/users/ccce9b53094a4a33a638165eb5571313/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:24.879960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b879f-6e7a-4644-80cc-6ef49bca8b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2aba48947ba41c69424c0bffacf791f, user_id=ccce9b53094a4a33a638165eb5571313, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:24.883282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b879f-6e7a-4644-80cc-6ef49bca8b72 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:24.893446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1166/2307] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:41:24 2022] PUT /identity/v3/projects/c2aba48947ba41c69424c0bffacf791f/users/ccce9b53094a4a33a638165eb5571313/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:26.473414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d057b-f6a1-4917-af1e-25584b5be1bb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:26.473945 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d057b-f6a1-4917-af1e-25584b5be1bb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:26.474042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021d057b-f6a1-4917-af1e-25584b5be1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:26.511065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-021d057b-f6a1-4917-af1e-25584b5be1bb None None] MFA Rules not processed for user `ccce9b53094a4a33a638165eb5571313`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:26.512341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-021d057b-f6a1-4917-af1e-25584b5be1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:26.543065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:26.589043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1142/2308] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:26 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:41:28.023805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b879f-6e7a-4644-80cc-6ef49bca8b72 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:28.089213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b879f-6e7a-4644-80cc-6ef49bca8b72 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:28.093802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:28.094668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:28.094954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:28.095347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] PATH_INFO: `/v3/users/ddc80fcfb1b34ebaae233f926604d2b6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:28.096576 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddc80fcfb1b34ebaae233f926604d2b6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:28.101222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:28.420831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddc80fcfb1b34ebaae233f926604d2b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:28.434569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddc80fcfb1b34ebaae233f926604d2b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:28.438195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:28.563428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddc80fcfb1b34ebaae233f926604d2b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:28.564782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddc80fcfb1b34ebaae233f926604d2b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:28.565444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddc80fcfb1b34ebaae233f926604d2b6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:28.567444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d057b-f6a1-4917-af1e-25584b5be1bb None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:28.578669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1167/2309] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:41:28 2022] DELETE /identity/v3/users/ddc80fcfb1b34ebaae233f926604d2b6 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:41:28.628842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021d057b-f6a1-4917-af1e-25584b5be1bb None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:28.682081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:28.682734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:28.683013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:28.683289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:28.685071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:28.756600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:28.758820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:28.769798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1143/2310] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:41:28.832139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:28.832139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:28.907479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6d429e-561d-4ccb-8145-7aff13097c01 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:28.912255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:28.913142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:28.913953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:28.914238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] PATH_INFO: `/v3/projects/a7f8cad467754a41870947a4d7981cd8` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:28.915418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7f8cad467754a41870947a4d7981cd8)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:28.917405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:28.949569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:28.951042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:28.962572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822aee2-170d-4dc7-b701-88dbcadbda99 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:28.966424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a43fd-bd2a-4b7d-9f92-74c888703978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:28.967172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a43fd-bd2a-4b7d-9f92-74c888703978 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:28.967455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a43fd-bd2a-4b7d-9f92-74c888703978 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:28.967758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a43fd-bd2a-4b7d-9f92-74c888703978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:28.969517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-460a43fd-bd2a-4b7d-9f92-74c888703978 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:28.989468 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a43fd-bd2a-4b7d-9f92-74c888703978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:28.990942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a43fd-bd2a-4b7d-9f92-74c888703978 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:29.002896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1144/2311] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:41:29.041341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7f8cad467754a41870947a4d7981cd8', 'request_id': 'req-b89eb14e-26c6-4230-b14b-710c3b88f2d3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.047623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7f8cad467754a41870947a4d7981cd8', 'request_id': 'req-b89eb14e-26c6-4230-b14b-710c3b88f2d3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.053387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7f8cad467754a41870947a4d7981cd8', 'request_id': 'req-b89eb14e-26c6-4230-b14b-710c3b88f2d3'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.191377 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] The token cache is being invalidate because project a7f8cad467754a41870947a4d7981cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:41:29.191755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.192496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.194094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1168/2312] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:41:28 2022] DELETE /identity/v3/projects/a7f8cad467754a41870947a4d7981cd8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:29.198115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a43fd-bd2a-4b7d-9f92-74c888703978 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:29.208716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a43fd-bd2a-4b7d-9f92-74c888703978 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:29.213224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:29.270134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:29.271049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:29.271707 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:29.271707 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] PATH_INFO: `/v3/users/ccce9b53094a4a33a638165eb5571313` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:29.273435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccce9b53094a4a33a638165eb5571313)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:29.275696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:29.458022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccce9b53094a4a33a638165eb5571313'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.478468 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccce9b53094a4a33a638165eb5571313'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.479256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccce9b53094a4a33a638165eb5571313'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.495204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccce9b53094a4a33a638165eb5571313'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.495942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b25a7642-9e3a-4867-9a03-c86ce73956fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccce9b53094a4a33a638165eb5571313'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:29.578043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1145/2313] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:41:29 2022] DELETE /identity/v3/users/ccce9b53094a4a33a638165eb5571313 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:29.848012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:29.849659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:29.864573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89eb14e-26c6-4230-b14b-710c3b88f2d3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:29.937191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:29.938075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:29.938382 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:29.938678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] PATH_INFO: `/v3/projects/c2aba48947ba41c69424c0bffacf791f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:29.939876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2aba48947ba41c69424c0bffacf791f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:29.942154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:29.966120 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:30.098238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2aba48947ba41c69424c0bffacf791f', 'request_id': 'req-a6fd3416-4885-4437-8a3b-fab323890b04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:30.104398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2aba48947ba41c69424c0bffacf791f', 'request_id': 'req-a6fd3416-4885-4437-8a3b-fab323890b04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:30.110117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2aba48947ba41c69424c0bffacf791f', 'request_id': 'req-a6fd3416-4885-4437-8a3b-fab323890b04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:30.188285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] The token cache is being invalidate because project c2aba48947ba41c69424c0bffacf791f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:41:30.188607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:30.189392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a6fd3416-4885-4437-8a3b-fab323890b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:30.191026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1169/2314] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:41:29 2022] DELETE /identity/v3/projects/c2aba48947ba41c69424c0bffacf791f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:30.196057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d906-fe79-44e8-9639-5267084711b6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:30.196369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d906-fe79-44e8-9639-5267084711b6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:30.196675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617d906-fe79-44e8-9639-5267084711b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:30.215173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e617d906-fe79-44e8-9639-5267084711b6 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:30.216471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e617d906-fe79-44e8-9639-5267084711b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:30.278244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1146/2315] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:30.286495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85c7ab-2e4a-4c2f-9e31-0511c93e8a70 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:30.286790 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85c7ab-2e4a-4c2f-9e31-0511c93e8a70 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:30.287079 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea85c7ab-2e4a-4c2f-9e31-0511c93e8a70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:30.311042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ea85c7ab-2e4a-4c2f-9e31-0511c93e8a70 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:30.312823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ea85c7ab-2e4a-4c2f-9e31-0511c93e8a70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:30.324492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1170/2316] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:30.326373 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d906-fe79-44e8-9639-5267084711b6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:30.340129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617d906-fe79-44e8-9639-5267084711b6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:30.345556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a0b41-2e1a-4a74-a884-ac8e02b90bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:30.346219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a0b41-2e1a-4a74-a884-ac8e02b90bae admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:30.349379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a0b41-2e1a-4a74-a884-ac8e02b90bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:30.349379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a0b41-2e1a-4a74-a884-ac8e02b90bae admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:30.349379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a0b41-2e1a-4a74-a884-ac8e02b90bae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:41:30.349379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a0b41-2e1a-4a74-a884-ac8e02b90bae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:30.349850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a0b41-2e1a-4a74-a884-ac8e02b90bae admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:30.371273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1147/2317] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:41:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:41:30.372343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85c7ab-2e4a-4c2f-9e31-0511c93e8a70 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:30.384013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea85c7ab-2e4a-4c2f-9e31-0511c93e8a70 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:30.388815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47882950-b38d-4273-b042-3802e9689eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:30.389555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47882950-b38d-4273-b042-3802e9689eff admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:30.389834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47882950-b38d-4273-b042-3802e9689eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:30.390104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47882950-b38d-4273-b042-3802e9689eff admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:30.390798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47882950-b38d-4273-b042-3802e9689eff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:30.392743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47882950-b38d-4273-b042-3802e9689eff admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:30.560223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1171/2318] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:41:30 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:41:30.561670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a0b41-2e1a-4a74-a884-ac8e02b90bae admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:30.572697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a0b41-2e1a-4a74-a884-ac8e02b90bae admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:30.588703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:30.638435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3261427-5e74-4f0d-bfbb-1a1d2333938d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:30.639144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3261427-5e74-4f0d-bfbb-1a1d2333938d admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:30.639428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3261427-5e74-4f0d-bfbb-1a1d2333938d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:30.639706 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3261427-5e74-4f0d-bfbb-1a1d2333938d admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:30.640407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3261427-5e74-4f0d-bfbb-1a1d2333938d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:30.642360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3261427-5e74-4f0d-bfbb-1a1d2333938d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:30.809681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1148/2319] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:41:30 2022] POST /identity/v3/users => generated 286 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:41:30.811065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47882950-b38d-4273-b042-3802e9689eff admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:30.821562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47882950-b38d-4273-b042-3802e9689eff admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:30.826117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29dd6c-9f21-4a3e-8876-2fb0722c82f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:30.826778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29dd6c-9f21-4a3e-8876-2fb0722c82f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:30.827215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29dd6c-9f21-4a3e-8876-2fb0722c82f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:30.827508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29dd6c-9f21-4a3e-8876-2fb0722c82f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:30.828212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29dd6c-9f21-4a3e-8876-2fb0722c82f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:30.829890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d29dd6c-9f21-4a3e-8876-2fb0722c82f4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:30.841132 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1172/2320] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:30.844963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3261427-5e74-4f0d-bfbb-1a1d2333938d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:30.856317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3261427-5e74-4f0d-bfbb-1a1d2333938d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:30.861056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f8e39c-c1e0-4348-844b-eff895a6c8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:30.861973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8e39c-c1e0-4348-844b-eff895a6c8b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:30.862256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8e39c-c1e0-4348-844b-eff895a6c8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:30.862592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f8e39c-c1e0-4348-844b-eff895a6c8b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:30.863328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8e39c-c1e0-4348-844b-eff895a6c8b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:30.864982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f8e39c-c1e0-4348-844b-eff895a6c8b2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:30.875335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1149/2321] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:30.879570 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29dd6c-9f21-4a3e-8876-2fb0722c82f4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:30.890267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29dd6c-9f21-4a3e-8876-2fb0722c82f4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:30.895028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee85a60-163a-499e-94c6-e2ccf1b418e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:30.895943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee85a60-163a-499e-94c6-e2ccf1b418e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:30.896226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee85a60-163a-499e-94c6-e2ccf1b418e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:30.896527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee85a60-163a-499e-94c6-e2ccf1b418e6 admin admin] PATH_INFO: `/v3/projects/1db971f20104495ba01766535fcce4f0/users/6515bf6de8e2407abe9cd62cef7f853b/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:30.912996 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee85a60-163a-499e-94c6-e2ccf1b418e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db971f20104495ba01766535fcce4f0, user_id=6515bf6de8e2407abe9cd62cef7f853b, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:30.916400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee85a60-163a-499e-94c6-e2ccf1b418e6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:31.006974 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1173/2322] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:41:30 2022] PUT /identity/v3/projects/1db971f20104495ba01766535fcce4f0/users/6515bf6de8e2407abe9cd62cef7f853b/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:31.017775 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a92e2-908d-4675-aa7e-a82e8481d186 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:31.018183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a92e2-908d-4675-aa7e-a82e8481d186 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:31.018521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180a92e2-908d-4675-aa7e-a82e8481d186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:31.045816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-180a92e2-908d-4675-aa7e-a82e8481d186 None None] MFA Rules not processed for user `6515bf6de8e2407abe9cd62cef7f853b`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:31.047046 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-180a92e2-908d-4675-aa7e-a82e8481d186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:31.117286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1150/2323] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:31.121969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee85a60-163a-499e-94c6-e2ccf1b418e6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:31.203701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee85a60-163a-499e-94c6-e2ccf1b418e6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:31.208958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01bc18-6054-414a-9457-ac72919cda3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:31.209545 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01bc18-6054-414a-9457-ac72919cda3f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:31.209894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01bc18-6054-414a-9457-ac72919cda3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:31.210872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca01bc18-6054-414a-9457-ac72919cda3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:31.211652 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01bc18-6054-414a-9457-ac72919cda3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:31.217986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca01bc18-6054-414a-9457-ac72919cda3f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:31.353492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1174/2324] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:41:31 2022] POST /identity/v3/projects => generated 371 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:41:31.354680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a92e2-908d-4675-aa7e-a82e8481d186 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:31.365528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180a92e2-908d-4675-aa7e-a82e8481d186 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:31.423366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc3b6-76e0-4c26-88ea-8e218abe9573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:31.424043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc3b6-76e0-4c26-88ea-8e218abe9573 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:31.424327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc3b6-76e0-4c26-88ea-8e218abe9573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:31.424642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948dc3b6-76e0-4c26-88ea-8e218abe9573 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:31.425347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc3b6-76e0-4c26-88ea-8e218abe9573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:31.427275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948dc3b6-76e0-4c26-88ea-8e218abe9573 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:31.550012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1151/2325] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:41:31 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:41:31.550499 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01bc18-6054-414a-9457-ac72919cda3f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:31.561241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca01bc18-6054-414a-9457-ac72919cda3f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:31.565756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5ad33-a3db-45fc-9c70-73f6b95e03d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:31.566417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5ad33-a3db-45fc-9c70-73f6b95e03d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:31.570937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5ad33-a3db-45fc-9c70-73f6b95e03d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:31.570937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5ad33-a3db-45fc-9c70-73f6b95e03d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:31.570937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5ad33-a3db-45fc-9c70-73f6b95e03d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:31.570937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5ad33-a3db-45fc-9c70-73f6b95e03d6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:31.581922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1175/2326] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:31.586444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc3b6-76e0-4c26-88ea-8e218abe9573 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:31.596795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948dc3b6-76e0-4c26-88ea-8e218abe9573 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:31.601670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a80b-da62-4572-8da3-a8773f68eb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:31.602568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a80b-da62-4572-8da3-a8773f68eb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:31.602849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a80b-da62-4572-8da3-a8773f68eb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:31.603121 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161a80b-da62-4572-8da3-a8773f68eb77 admin admin] PATH_INFO: `/v3/projects/39e51a49c3164060b31f02a78e90840e/users/655dcdda8dff4d228ac064562651ab8f/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:31.614192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:31.621537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161a80b-da62-4572-8da3-a8773f68eb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e51a49c3164060b31f02a78e90840e, user_id=655dcdda8dff4d228ac064562651ab8f, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:31.624335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161a80b-da62-4572-8da3-a8773f68eb77 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:31.720610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1152/2327] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:41:31 2022] PUT /identity/v3/projects/39e51a49c3164060b31f02a78e90840e/users/655dcdda8dff4d228ac064562651ab8f/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:41:31.730166 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5ad33-a3db-45fc-9c70-73f6b95e03d6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:31.743726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5ad33-a3db-45fc-9c70-73f6b95e03d6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:31.763783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:31.811048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b000b2d4-b232-46cc-978f-e0427faa7906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:31.811843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b2d4-b232-46cc-978f-e0427faa7906 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:31.812213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b2d4-b232-46cc-978f-e0427faa7906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:31.812651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b000b2d4-b232-46cc-978f-e0427faa7906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:31.813488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000b2d4-b232-46cc-978f-e0427faa7906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:31.815180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b000b2d4-b232-46cc-978f-e0427faa7906 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:31.826138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1176/2328] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:31 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:31.830202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a80b-da62-4572-8da3-a8773f68eb77 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:31.840903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161a80b-da62-4572-8da3-a8773f68eb77 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:31.845935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c52c-ca78-4141-ab3f-fe11a5af789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:31.846813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c52c-ca78-4141-ab3f-fe11a5af789d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:31.847096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c52c-ca78-4141-ab3f-fe11a5af789d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:31.847368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c52c-ca78-4141-ab3f-fe11a5af789d admin admin] PATH_INFO: `/v3/projects/39e51a49c3164060b31f02a78e90840e/users/655dcdda8dff4d228ac064562651ab8f/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:31.849366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84c52c-ca78-4141-ab3f-fe11a5af789d admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e51a49c3164060b31f02a78e90840e, user_id=655dcdda8dff4d228ac064562651ab8f, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:31.853056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84c52c-ca78-4141-ab3f-fe11a5af789d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:31.863990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1153/2329] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:41:31 2022] PUT /identity/v3/projects/39e51a49c3164060b31f02a78e90840e/users/655dcdda8dff4d228ac064562651ab8f/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:31.876328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38d2f0-955d-4d11-ac62-6932271c02ea None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:31.876671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38d2f0-955d-4d11-ac62-6932271c02ea None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:31.876946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38d2f0-955d-4d11-ac62-6932271c02ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:31.905869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9c38d2f0-955d-4d11-ac62-6932271c02ea None None] MFA Rules not processed for user `655dcdda8dff4d228ac064562651ab8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:31.907176 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9c38d2f0-955d-4d11-ac62-6932271c02ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:31.977436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1177/2330] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:41:31.996867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c52c-ca78-4141-ab3f-fe11a5af789d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:31.998577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8a84c52c-ca78-4141-ab3f-fe11a5af789d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:32.060271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c52c-ca78-4141-ab3f-fe11a5af789d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:32.063905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6831d656-f68a-4ed2-aa80-c1620440b87f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:32.064687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d656-f68a-4ed2-aa80-c1620440b87f service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:32.065010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d656-f68a-4ed2-aa80-c1620440b87f service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:32.065288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6831d656-f68a-4ed2-aa80-c1620440b87f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:32.074916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d656-f68a-4ed2-aa80-c1620440b87f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:32.076411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6831d656-f68a-4ed2-aa80-c1620440b87f service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:32.087543 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1154/2331] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:31 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:41:33.294530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38d2f0-955d-4d11-ac62-6932271c02ea None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:33.369726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38d2f0-955d-4d11-ac62-6932271c02ea None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:33.380208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:33.380208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:33.380208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:33.380208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] PATH_INFO: `/v3/users/6515bf6de8e2407abe9cd62cef7f853b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:33.380794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6515bf6de8e2407abe9cd62cef7f853b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:33.380794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:33.675890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:33.681891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6515bf6de8e2407abe9cd62cef7f853b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:33.701430 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6515bf6de8e2407abe9cd62cef7f853b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:33.811771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6515bf6de8e2407abe9cd62cef7f853b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:33.812973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6515bf6de8e2407abe9cd62cef7f853b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:33.813591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6515bf6de8e2407abe9cd62cef7f853b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:33.828558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1178/2332] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:41:33 2022] DELETE /identity/v3/users/6515bf6de8e2407abe9cd62cef7f853b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:33.833093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45270c13-4b71-41bc-859c-d8940e6023f6 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:33.833691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45270c13-4b71-41bc-859c-d8940e6023f6 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:33.833784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45270c13-4b71-41bc-859c-d8940e6023f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:33.852971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-45270c13-4b71-41bc-859c-d8940e6023f6 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:33.854192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-45270c13-4b71-41bc-859c-d8940e6023f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:33.919246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1155/2333] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:33.932654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:33.934101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:34.004017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d1397-bdba-4e86-baf2-72858c4128bc admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:34.008109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eed619-313c-4759-9b0c-4737f4df7c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:34.008846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eed619-313c-4759-9b0c-4737f4df7c7c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:34.009130 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eed619-313c-4759-9b0c-4737f4df7c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:34.009404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eed619-313c-4759-9b0c-4737f4df7c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:34.019371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eed619-313c-4759-9b0c-4737f4df7c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:34.021163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eed619-313c-4759-9b0c-4737f4df7c7c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:34.034239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1179/2334] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:41:34.470227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45270c13-4b71-41bc-859c-d8940e6023f6 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:34.471635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-45270c13-4b71-41bc-859c-d8940e6023f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:34.483761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45270c13-4b71-41bc-859c-d8940e6023f6 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:34.489127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:34.490013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:34.490300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:34.490568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] PATH_INFO: `/v3/projects/1db971f20104495ba01766535fcce4f0` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:34.493707 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db971f20104495ba01766535fcce4f0)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:34.495728 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:34.606629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db971f20104495ba01766535fcce4f0', 'request_id': 'req-e1c16f34-e71b-4986-9d06-0f1a9b755e88'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:34.613435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db971f20104495ba01766535fcce4f0', 'request_id': 'req-e1c16f34-e71b-4986-9d06-0f1a9b755e88'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:34.620044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db971f20104495ba01766535fcce4f0', 'request_id': 'req-e1c16f34-e71b-4986-9d06-0f1a9b755e88'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:34.724514 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:34.729082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] The token cache is being invalidate because project 1db971f20104495ba01766535fcce4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:41:34.729369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:34.729973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:34.731505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1156/2335] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:41:34 2022] DELETE /identity/v3/projects/1db971f20104495ba01766535fcce4f0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:34.735400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eed619-313c-4759-9b0c-4737f4df7c7c service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:34.746573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eed619-313c-4759-9b0c-4737f4df7c7c service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:34.808347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:34.809293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:34.809716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:34.809999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] PATH_INFO: `/v3/users/655dcdda8dff4d228ac064562651ab8f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:34.811207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=655dcdda8dff4d228ac064562651ab8f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:34.813232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:35.031970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '655dcdda8dff4d228ac064562651ab8f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:35.043848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:35.045261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '655dcdda8dff4d228ac064562651ab8f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:35.194296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '655dcdda8dff4d228ac064562651ab8f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:35.195195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '655dcdda8dff4d228ac064562651ab8f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:35.195810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-181a4a49-ce84-4d6f-a9d8-8419ec88b9e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '655dcdda8dff4d228ac064562651ab8f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:35.209099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1180/2336] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:41:34 2022] DELETE /identity/v3/users/655dcdda8dff4d228ac064562651ab8f => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:35.751558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:35.753135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:35.766850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c16f34-e71b-4986-9d06-0f1a9b755e88 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:35.827898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:35.828887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:35.829168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:35.829442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] PATH_INFO: `/v3/projects/39e51a49c3164060b31f02a78e90840e` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:35.830910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e51a49c3164060b31f02a78e90840e)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:35.832812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:35.961541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e51a49c3164060b31f02a78e90840e', 'request_id': 'req-a8225517-dced-4d1c-be4f-84dc96ad834d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:35.967809 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e51a49c3164060b31f02a78e90840e', 'request_id': 'req-a8225517-dced-4d1c-be4f-84dc96ad834d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:35.973201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e51a49c3164060b31f02a78e90840e', 'request_id': 'req-a8225517-dced-4d1c-be4f-84dc96ad834d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:36.047898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] The token cache is being invalidate because project 39e51a49c3164060b31f02a78e90840e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:41:36.048189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:36.049162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a8225517-dced-4d1c-be4f-84dc96ad834d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:41:36.050437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1157/2337] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:41:35 2022] DELETE /identity/v3/projects/39e51a49c3164060b31f02a78e90840e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:36.055455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbac9b8-d392-4971-a8f3-f956efd2e21e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.055911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbac9b8-d392-4971-a8f3-f956efd2e21e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.056004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbac9b8-d392-4971-a8f3-f956efd2e21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.074259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2fbac9b8-d392-4971-a8f3-f956efd2e21e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:36.075440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2fbac9b8-d392-4971-a8f3-f956efd2e21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:36.139386 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1181/2338] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:36.147069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6fbfb-7c97-4b1b-a1ef-13f6467a2681 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.147365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6fbfb-7c97-4b1b-a1ef-13f6467a2681 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.148351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f6fbfb-7c97-4b1b-a1ef-13f6467a2681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.167795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f8f6fbfb-7c97-4b1b-a1ef-13f6467a2681 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:36.169106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f8f6fbfb-7c97-4b1b-a1ef-13f6467a2681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:36.177164 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1158/2339] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:36.181456 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbac9b8-d392-4971-a8f3-f956efd2e21e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:36.191202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbac9b8-d392-4971-a8f3-f956efd2e21e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:36.197895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e465c-fe56-44a4-9197-b22265f40e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:36.198752 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e465c-fe56-44a4-9197-b22265f40e57 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.199040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e465c-fe56-44a4-9197-b22265f40e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.199308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e465c-fe56-44a4-9197-b22265f40e57 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.200039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e465c-fe56-44a4-9197-b22265f40e57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:41:36.200343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e465c-fe56-44a4-9197-b22265f40e57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:36.201991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e465c-fe56-44a4-9197-b22265f40e57 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:36.214728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1182/2340] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:41:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:41:36.219529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6fbfb-7c97-4b1b-a1ef-13f6467a2681 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:36.229129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f6fbfb-7c97-4b1b-a1ef-13f6467a2681 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:36.234022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216fc8-ab71-4d41-8341-59447a048310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:36.234813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216fc8-ab71-4d41-8341-59447a048310 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.234982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216fc8-ab71-4d41-8341-59447a048310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.235258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7216fc8-ab71-4d41-8341-59447a048310 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.236307 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7216fc8-ab71-4d41-8341-59447a048310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:36.238316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7216fc8-ab71-4d41-8341-59447a048310 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:36.346352 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1159/2341] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:41:36 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:41:36.350389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e465c-fe56-44a4-9197-b22265f40e57 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:36.361924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e465c-fe56-44a4-9197-b22265f40e57 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:36.421758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e614ad-8d6c-4fe5-917e-7f574d2edb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:36.422437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e614ad-8d6c-4fe5-917e-7f574d2edb89 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.422723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e614ad-8d6c-4fe5-917e-7f574d2edb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.423003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e614ad-8d6c-4fe5-917e-7f574d2edb89 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.423699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e614ad-8d6c-4fe5-917e-7f574d2edb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:36.425679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e614ad-8d6c-4fe5-917e-7f574d2edb89 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:36.500565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1183/2342] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:41:36 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:41:36.504740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216fc8-ab71-4d41-8341-59447a048310 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:36.515811 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7216fc8-ab71-4d41-8341-59447a048310 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:36.520534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665c824-247a-4abc-aa93-25d1637458db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:36.521197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665c824-247a-4abc-aa93-25d1637458db admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.521483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665c824-247a-4abc-aa93-25d1637458db admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.521757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a665c824-247a-4abc-aa93-25d1637458db admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.522483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665c824-247a-4abc-aa93-25d1637458db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:36.524790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a665c824-247a-4abc-aa93-25d1637458db admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:36.536089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1160/2343] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:36.540447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e614ad-8d6c-4fe5-917e-7f574d2edb89 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:36.550748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e614ad-8d6c-4fe5-917e-7f574d2edb89 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:36.556019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec874ed-5b61-47e5-99e3-2543de04b6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:36.556721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec874ed-5b61-47e5-99e3-2543de04b6ee admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.557005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec874ed-5b61-47e5-99e3-2543de04b6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.557280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec874ed-5b61-47e5-99e3-2543de04b6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.558001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec874ed-5b61-47e5-99e3-2543de04b6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:36.559605 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec874ed-5b61-47e5-99e3-2543de04b6ee admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:36.572353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1184/2344] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:36.576639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665c824-247a-4abc-aa93-25d1637458db admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:36.587409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a665c824-247a-4abc-aa93-25d1637458db admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:36.592418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d501c-8fd7-4eb0-b39f-5f5ea634c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:36.593212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d501c-8fd7-4eb0-b39f-5f5ea634c2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.593441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d501c-8fd7-4eb0-b39f-5f5ea634c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.593716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64d501c-8fd7-4eb0-b39f-5f5ea634c2c0 admin admin] PATH_INFO: `/v3/projects/1e0359891d704abdb75b53c124caa98c/users/eb5c73a7a63b42329a2cdd253f54d0c0/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.608856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d501c-8fd7-4eb0-b39f-5f5ea634c2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e0359891d704abdb75b53c124caa98c, user_id=eb5c73a7a63b42329a2cdd253f54d0c0, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:36.611806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64d501c-8fd7-4eb0-b39f-5f5ea634c2c0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:36.677737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1161/2345] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:41:36 2022] PUT /identity/v3/projects/1e0359891d704abdb75b53c124caa98c/users/eb5c73a7a63b42329a2cdd253f54d0c0/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:41:36.688631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36ca70-1222-4f2e-9497-479f44bcb515 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.688925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36ca70-1222-4f2e-9497-479f44bcb515 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.689209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf36ca70-1222-4f2e-9497-479f44bcb515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.715582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-bf36ca70-1222-4f2e-9497-479f44bcb515 None None] MFA Rules not processed for user `eb5c73a7a63b42329a2cdd253f54d0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:36.716762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bf36ca70-1222-4f2e-9497-479f44bcb515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:36.749006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:36.780054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1185/2346] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:36.784553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d501c-8fd7-4eb0-b39f-5f5ea634c2c0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:36.814774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:36.846625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64d501c-8fd7-4eb0-b39f-5f5ea634c2c0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:36.851783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d004e-ea9b-4688-bb9e-afbab8bf98c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:36.855349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d004e-ea9b-4688-bb9e-afbab8bf98c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:36.855349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d004e-ea9b-4688-bb9e-afbab8bf98c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:36.855349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d004e-ea9b-4688-bb9e-afbab8bf98c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:36.855349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d004e-ea9b-4688-bb9e-afbab8bf98c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:36.855795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d004e-ea9b-4688-bb9e-afbab8bf98c8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:36.988558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1162/2347] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:41:36 2022] POST /identity/v3/projects => generated 375 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:41:36.989709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36ca70-1222-4f2e-9497-479f44bcb515 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:37.001650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf36ca70-1222-4f2e-9497-479f44bcb515 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:37.061031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac60438-7350-4991-b307-62d593413e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:37.061699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac60438-7350-4991-b307-62d593413e29 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:37.061982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac60438-7350-4991-b307-62d593413e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:37.062263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac60438-7350-4991-b307-62d593413e29 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:37.062956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac60438-7350-4991-b307-62d593413e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:37.065055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac60438-7350-4991-b307-62d593413e29 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:37.155560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1186/2348] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:41:36 2022] POST /identity/v3/users => generated 294 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:41:37.159680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d004e-ea9b-4688-bb9e-afbab8bf98c8 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:37.171287 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d004e-ea9b-4688-bb9e-afbab8bf98c8 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:37.176400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d0187-3b4c-488e-826f-4a956b955ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:37.177110 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d0187-3b4c-488e-826f-4a956b955ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:37.177559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d0187-3b4c-488e-826f-4a956b955ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:37.177864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d0187-3b4c-488e-826f-4a956b955ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:37.178669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d0187-3b4c-488e-826f-4a956b955ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:37.181216 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d0187-3b4c-488e-826f-4a956b955ce1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:37.192368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1163/2349] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:37.196931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac60438-7350-4991-b307-62d593413e29 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:37.207098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac60438-7350-4991-b307-62d593413e29 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:37.212046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d9257-fa8b-4c35-9a11-5437f5269cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:37.212995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d9257-fa8b-4c35-9a11-5437f5269cae admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:37.213272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d9257-fa8b-4c35-9a11-5437f5269cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:37.213543 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d9257-fa8b-4c35-9a11-5437f5269cae admin admin] PATH_INFO: `/v3/projects/8f0d718feca74922b73eb2b43e4f372d/users/93896c619b97468e841432c98261d7b9/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:37.228598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d9257-fa8b-4c35-9a11-5437f5269cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0d718feca74922b73eb2b43e4f372d, user_id=93896c619b97468e841432c98261d7b9, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:37.231302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d9257-fa8b-4c35-9a11-5437f5269cae admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:37.324033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1187/2350] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:41:37 2022] PUT /identity/v3/projects/8f0d718feca74922b73eb2b43e4f372d/users/93896c619b97468e841432c98261d7b9/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:37.328160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d0187-3b4c-488e-826f-4a956b955ce1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:37.340936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d0187-3b4c-488e-826f-4a956b955ce1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:37.402847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2205f8e-a2ec-4d98-a6b1-91a13ac4201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:37.403850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2205f8e-a2ec-4d98-a6b1-91a13ac4201d admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:37.404137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2205f8e-a2ec-4d98-a6b1-91a13ac4201d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:37.404413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2205f8e-a2ec-4d98-a6b1-91a13ac4201d admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:37.405175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2205f8e-a2ec-4d98-a6b1-91a13ac4201d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:37.406856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2205f8e-a2ec-4d98-a6b1-91a13ac4201d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:37.420517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1164/2351] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:41:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:41:37.422686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d9257-fa8b-4c35-9a11-5437f5269cae admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:37.433148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d9257-fa8b-4c35-9a11-5437f5269cae admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:37.437959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc6ac-e7fb-475a-94c8-3ef760697bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:37.438833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc6ac-e7fb-475a-94c8-3ef760697bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:37.441522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc6ac-e7fb-475a-94c8-3ef760697bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:37.441522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3bc6ac-e7fb-475a-94c8-3ef760697bcd admin admin] PATH_INFO: `/v3/projects/8f0d718feca74922b73eb2b43e4f372d/users/93896c619b97468e841432c98261d7b9/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:37.441522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc6ac-e7fb-475a-94c8-3ef760697bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f0d718feca74922b73eb2b43e4f372d, user_id=93896c619b97468e841432c98261d7b9, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:37.444062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3bc6ac-e7fb-475a-94c8-3ef760697bcd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:37.454583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1188/2352] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:41:37 2022] PUT /identity/v3/projects/8f0d718feca74922b73eb2b43e4f372d/users/93896c619b97468e841432c98261d7b9/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:41:37.466398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa318a2-cfdb-41c8-93a5-dc916141d3d3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:37.466691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa318a2-cfdb-41c8-93a5-dc916141d3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:37.466974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa318a2-cfdb-41c8-93a5-dc916141d3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:37.494732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-baa318a2-cfdb-41c8-93a5-dc916141d3d3 None None] MFA Rules not processed for user `93896c619b97468e841432c98261d7b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:37.496638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-baa318a2-cfdb-41c8-93a5-dc916141d3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:37.568685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1165/2353] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:37 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:37.579507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc6ac-e7fb-475a-94c8-3ef760697bcd admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:37.581360 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5f3bc6ac-e7fb-475a-94c8-3ef760697bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:37.649169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3bc6ac-e7fb-475a-94c8-3ef760697bcd admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:37.652889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4eca1-1b09-4175-8147-3c32f4c1472b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:37.653536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4eca1-1b09-4175-8147-3c32f4c1472b service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:37.653849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4eca1-1b09-4175-8147-3c32f4c1472b service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:37.654098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a4eca1-1b09-4175-8147-3c32f4c1472b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:37.698249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:37.713238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4eca1-1b09-4175-8147-3c32f4c1472b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:37.714696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a4eca1-1b09-4175-8147-3c32f4c1472b service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:37.724027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1189/2354] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:41:37.993217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e7e6a-7f2b-4a27-9142-23e7b63bb886 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:37.994998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e7e6a-7f2b-4a27-9142-23e7b63bb886 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:37.994998 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2e7e6a-7f2b-4a27-9142-23e7b63bb886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:38.011915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ff2e7e6a-7f2b-4a27-9142-23e7b63bb886 None None] MFA Rules not processed for user `0487ea9076ee4baf8138fdc25ce02522`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:41:38.013187 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ff2e7e6a-7f2b-4a27-9142-23e7b63bb886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:38.031095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:38.069281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1166/2355] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:41:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:41:38.389731 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4eca1-1b09-4175-8147-3c32f4c1472b service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:38.390878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b7a4eca1-1b09-4175-8147-3c32f4c1472b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:38.471126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a4eca1-1b09-4175-8147-3c32f4c1472b service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:38.474966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:38.475610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:38.476682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:38.476992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:38.478819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:38.489915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:38.491404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:38.501015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1190/2356] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:41:39.212531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e7e6a-7f2b-4a27-9142-23e7b63bb886 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:39.214290 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ff2e7e6a-7f2b-4a27-9142-23e7b63bb886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:39.304311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2e7e6a-7f2b-4a27-9142-23e7b63bb886 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:39.309847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666cf8b-1e69-453c-85b9-5ffa38d7dc05 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:39.310469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666cf8b-1e69-453c-85b9-5ffa38d7dc05 service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:39.310749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666cf8b-1e69-453c-85b9-5ffa38d7dc05 service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:39.311023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666cf8b-1e69-453c-85b9-5ffa38d7dc05 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:39.312916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c666cf8b-1e69-453c-85b9-5ffa38d7dc05 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:39.325457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666cf8b-1e69-453c-85b9-5ffa38d7dc05 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:39.331348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666cf8b-1e69-453c-85b9-5ffa38d7dc05 service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:39.338379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1167/2357] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:41:41.377315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:41.378912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:41.454965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b4c4a-d03b-40ca-b7c2-c3a8d59925b1 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:41.464021 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:41.471889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:41.471889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:41.471889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:41.471889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:41.479186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:41.480809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:41.494649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1191/2358] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:41:44.194315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666cf8b-1e69-453c-85b9-5ffa38d7dc05 service placement] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:44.204212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666cf8b-1e69-453c-85b9-5ffa38d7dc05 service placement] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:44.207727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1c1d1-20b5-4eeb-9e5c-c0b09e951175 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:44.208362 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1c1d1-20b5-4eeb-9e5c-c0b09e951175 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:44.208689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1c1d1-20b5-4eeb-9e5c-c0b09e951175 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:44.208969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1c1d1-20b5-4eeb-9e5c-c0b09e951175 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:44.217828 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1c1d1-20b5-4eeb-9e5c-c0b09e951175 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:44.219277 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1c1d1-20b5-4eeb-9e5c-c0b09e951175 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:44.228964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1168/2359] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:41:47.309058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:47.310451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:47.325035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b5c73f-4eaf-406d-b722-431f102b6c1a service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:47.330317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd758d-22f1-4e4c-8056-3935504a2686 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:47.330942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd758d-22f1-4e4c-8056-3935504a2686 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:47.331220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd758d-22f1-4e4c-8056-3935504a2686 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:47.331490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd758d-22f1-4e4c-8056-3935504a2686 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:47.333188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-85bd758d-22f1-4e4c-8056-3935504a2686 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:47.390733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd758d-22f1-4e4c-8056-3935504a2686 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:47.392354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd758d-22f1-4e4c-8056-3935504a2686 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:47.401299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1192/2360] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:41:48.852170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1c1d1-20b5-4eeb-9e5c-c0b09e951175 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:41:48.862987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1c1d1-20b5-4eeb-9e5c-c0b09e951175 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:41:48.866785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:41:48.867650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:41:48.867751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:41:48.868074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:41:48.870341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:41:48.881275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:41:48.882716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:41:48.892218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1169/2361] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:41:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:41:57.397110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:58.888234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=59 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:03.553348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfda39c-a714-406f-943a-dac9aacc1b5e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:03.553823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfda39c-a714-406f-943a-dac9aacc1b5e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:03.553917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfda39c-a714-406f-943a-dac9aacc1b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:03.571612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-abfda39c-a714-406f-943a-dac9aacc1b5e None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:03.572804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-abfda39c-a714-406f-943a-dac9aacc1b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:03.629858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1193/2362] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:42:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:03.783889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:03.785318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:03.854484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b3781-8f0c-4373-9bed-e78033eb45ee service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:03.859532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be7a7-1091-4d96-90b3-a1464885395f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:03.860167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be7a7-1091-4d96-90b3-a1464885395f service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:03.860447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be7a7-1091-4d96-90b3-a1464885395f service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:03.860753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2be7a7-1091-4d96-90b3-a1464885395f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:03.868963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be7a7-1091-4d96-90b3-a1464885395f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:03.870532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2be7a7-1091-4d96-90b3-a1464885395f service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:03.879104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1170/2363] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:42:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:42:08.815827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfda39c-a714-406f-943a-dac9aacc1b5e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:08.833114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfda39c-a714-406f-943a-dac9aacc1b5e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:08.838782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7055f0-7a3c-401b-a1ad-96d86881dfe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:08.839654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7055f0-7a3c-401b-a1ad-96d86881dfe3 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:08.840185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7055f0-7a3c-401b-a1ad-96d86881dfe3 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:08.840787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7055f0-7a3c-401b-a1ad-96d86881dfe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:08.842864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4c7055f0-7a3c-401b-a1ad-96d86881dfe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:08.860423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7055f0-7a3c-401b-a1ad-96d86881dfe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:08.863926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7055f0-7a3c-401b-a1ad-96d86881dfe3 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:08.878020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1194/2364] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:42:12.014932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be7a7-1091-4d96-90b3-a1464885395f service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:12.088952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2be7a7-1091-4d96-90b3-a1464885395f service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:12.095268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:12.096308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:12.096735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:12.097147 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] PATH_INFO: `/v3/users/eb5c73a7a63b42329a2cdd253f54d0c0` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:12.098861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb5c73a7a63b42329a2cdd253f54d0c0)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:12.101099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:12.321773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb5c73a7a63b42329a2cdd253f54d0c0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:12.329841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb5c73a7a63b42329a2cdd253f54d0c0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:12.330644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb5c73a7a63b42329a2cdd253f54d0c0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:12.347588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb5c73a7a63b42329a2cdd253f54d0c0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:12.351336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb5c73a7a63b42329a2cdd253f54d0c0'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:12.438296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1171/2365] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:42:12 2022] DELETE /identity/v3/users/eb5c73a7a63b42329a2cdd253f54d0c0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:12.445285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941926f-4840-4488-a4e9-cc260db51a20 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:12.446173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941926f-4840-4488-a4e9-cc260db51a20 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:12.446460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e941926f-4840-4488-a4e9-cc260db51a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:12.469309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e941926f-4840-4488-a4e9-cc260db51a20 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:12.470778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e941926f-4840-4488-a4e9-cc260db51a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:12.551904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1195/2366] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:12.564181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:12.565787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:12.600348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:12.666538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecacefa-c520-4687-988a-bea16dcc0052 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:12.671528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7fc53-5c6c-4386-abac-a638a929a2d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:12.672336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7fc53-5c6c-4386-abac-a638a929a2d1 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:12.672669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7fc53-5c6c-4386-abac-a638a929a2d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:12.672949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f7fc53-5c6c-4386-abac-a638a929a2d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:12.684103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7fc53-5c6c-4386-abac-a638a929a2d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:12.686774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f7fc53-5c6c-4386-abac-a638a929a2d1 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:12.699049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1172/2367] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:42:13.357506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941926f-4840-4488-a4e9-cc260db51a20 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:13.359118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e941926f-4840-4488-a4e9-cc260db51a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:13.378556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e941926f-4840-4488-a4e9-cc260db51a20 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:13.385043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:13.386689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:13.386689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:13.386857 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] PATH_INFO: `/v3/projects/1e0359891d704abdb75b53c124caa98c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:13.388406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e0359891d704abdb75b53c124caa98c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:13.391807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:13.526471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e0359891d704abdb75b53c124caa98c', 'request_id': 'req-8b22f0e7-c174-416d-a1a9-4314b9aa0899'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:13.535241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e0359891d704abdb75b53c124caa98c', 'request_id': 'req-8b22f0e7-c174-416d-a1a9-4314b9aa0899'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:13.542891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e0359891d704abdb75b53c124caa98c', 'request_id': 'req-8b22f0e7-c174-416d-a1a9-4314b9aa0899'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:13.629328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] The token cache is being invalidate because project 1e0359891d704abdb75b53c124caa98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:42:13.629631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:13.630333 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:13.631893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1196/2368] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:42:13 2022] DELETE /identity/v3/projects/1e0359891d704abdb75b53c124caa98c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:13.637704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7fc53-5c6c-4386-abac-a638a929a2d1 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:13.647688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f7fc53-5c6c-4386-abac-a638a929a2d1 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:13.727700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:13.728795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:13.729078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:13.729351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] PATH_INFO: `/v3/users/93896c619b97468e841432c98261d7b9` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:13.730608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93896c619b97468e841432c98261d7b9)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:13.733649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:13.982384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93896c619b97468e841432c98261d7b9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:13.989776 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93896c619b97468e841432c98261d7b9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:13.990435 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93896c619b97468e841432c98261d7b9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:14.002739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93896c619b97468e841432c98261d7b9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:14.003372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ee6e003b-a3c4-4b8d-a186-ae4f7c35d36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93896c619b97468e841432c98261d7b9'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:14.116933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1173/2369] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:42:13 2022] DELETE /identity/v3/users/93896c619b97468e841432c98261d7b9 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:42:14.541362 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:14.541362 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:14.551764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f0e7-c174-416d-a1a9-4314b9aa0899 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:14.565205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:14.609979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:14.610888 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:14.611172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:14.611463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] PATH_INFO: `/v3/projects/8f0d718feca74922b73eb2b43e4f372d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:14.612914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f0d718feca74922b73eb2b43e4f372d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:14.614860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:14.717097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f0d718feca74922b73eb2b43e4f372d', 'request_id': 'req-84a75476-0dc2-412f-850b-2b4a7383665b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:14.723033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f0d718feca74922b73eb2b43e4f372d', 'request_id': 'req-84a75476-0dc2-412f-850b-2b4a7383665b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:14.728343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f0d718feca74922b73eb2b43e4f372d', 'request_id': 'req-84a75476-0dc2-412f-850b-2b4a7383665b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:14.819062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] The token cache is being invalidate because project 8f0d718feca74922b73eb2b43e4f372d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:42:14.819263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:14.819912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-84a75476-0dc2-412f-850b-2b4a7383665b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:14.824935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1197/2370] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:42:14 2022] DELETE /identity/v3/projects/8f0d718feca74922b73eb2b43e4f372d => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:14.827314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef4d9f-b0b5-4319-bb87-64b63e4c0769 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:14.827746 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef4d9f-b0b5-4319-bb87-64b63e4c0769 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:14.827854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef4d9f-b0b5-4319-bb87-64b63e4c0769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:14.849883 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-21ef4d9f-b0b5-4319-bb87-64b63e4c0769 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:14.851078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-21ef4d9f-b0b5-4319-bb87-64b63e4c0769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:14.881421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:14.916717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1174/2371] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:14.925564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2dc76-7766-40e8-84a4-098ab2f1c402 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:14.925958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2dc76-7766-40e8-84a4-098ab2f1c402 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:14.926364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2dc76-7766-40e8-84a4-098ab2f1c402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:14.946829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-3ce2dc76-7766-40e8-84a4-098ab2f1c402 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:14.948061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3ce2dc76-7766-40e8-84a4-098ab2f1c402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:14.956693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1198/2372] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:14.960948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef4d9f-b0b5-4319-bb87-64b63e4c0769 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:14.970867 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef4d9f-b0b5-4319-bb87-64b63e4c0769 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:14.975540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5e30-a638-4757-9235-c579168e7188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:14.976254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5e30-a638-4757-9235-c579168e7188 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:14.976835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5e30-a638-4757-9235-c579168e7188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:14.977185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab5e30-a638-4757-9235-c579168e7188 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:14.977941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab5e30-a638-4757-9235-c579168e7188 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:42:14.978445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab5e30-a638-4757-9235-c579168e7188 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:14.980578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab5e30-a638-4757-9235-c579168e7188 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:14.996766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1175/2373] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:42:14.998878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2dc76-7766-40e8-84a4-098ab2f1c402 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:15.008254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2dc76-7766-40e8-84a4-098ab2f1c402 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:15.014165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f97cf-7efe-46c6-94ae-7cace15c1ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:15.014165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f97cf-7efe-46c6-94ae-7cace15c1ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:15.014165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f97cf-7efe-46c6-94ae-7cace15c1ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:15.014437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f97cf-7efe-46c6-94ae-7cace15c1ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:15.015013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f97cf-7efe-46c6-94ae-7cace15c1ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:15.016959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f97cf-7efe-46c6-94ae-7cace15c1ff6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:15.114282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1199/2374] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:42:14 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:42:15.115737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5e30-a638-4757-9235-c579168e7188 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:15.125953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab5e30-a638-4757-9235-c579168e7188 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:15.184411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d000e6-b5bc-4e4c-8f55-d5d343934321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:15.185920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d000e6-b5bc-4e4c-8f55-d5d343934321 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:15.185920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d000e6-b5bc-4e4c-8f55-d5d343934321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:15.185920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d000e6-b5bc-4e4c-8f55-d5d343934321 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:15.186535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d000e6-b5bc-4e4c-8f55-d5d343934321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:15.188536 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d000e6-b5bc-4e4c-8f55-d5d343934321 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:15.307182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1176/2375] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:42:15 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:42:15.308428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f97cf-7efe-46c6-94ae-7cace15c1ff6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:15.318909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f97cf-7efe-46c6-94ae-7cace15c1ff6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:15.323496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99655a4f-7eec-423a-8d0e-ef380bd9fde3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:15.324154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655a4f-7eec-423a-8d0e-ef380bd9fde3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:15.324431 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655a4f-7eec-423a-8d0e-ef380bd9fde3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:15.324775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99655a4f-7eec-423a-8d0e-ef380bd9fde3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:15.325699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99655a4f-7eec-423a-8d0e-ef380bd9fde3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:15.327482 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99655a4f-7eec-423a-8d0e-ef380bd9fde3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:15.338350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1200/2376] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:42:15.342948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d000e6-b5bc-4e4c-8f55-d5d343934321 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:15.353233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d000e6-b5bc-4e4c-8f55-d5d343934321 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:15.358822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7aa79-dcbe-4bb9-a1ab-b8685e853750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:15.359617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7aa79-dcbe-4bb9-a1ab-b8685e853750 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:15.359964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7aa79-dcbe-4bb9-a1ab-b8685e853750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:15.360303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7aa79-dcbe-4bb9-a1ab-b8685e853750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:15.361067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7aa79-dcbe-4bb9-a1ab-b8685e853750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:15.362950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7aa79-dcbe-4bb9-a1ab-b8685e853750 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:15.376505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1177/2377] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:42:15.377616 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99655a4f-7eec-423a-8d0e-ef380bd9fde3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:15.388230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99655a4f-7eec-423a-8d0e-ef380bd9fde3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:15.392898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93415c0-5f53-4396-b65e-3413f24b6a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:15.393784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93415c0-5f53-4396-b65e-3413f24b6a19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:15.394096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93415c0-5f53-4396-b65e-3413f24b6a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:15.394381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93415c0-5f53-4396-b65e-3413f24b6a19 admin admin] PATH_INFO: `/v3/projects/642110d3da0540d88aec29535053de89/users/e63626b73eb545f79e7d9e3aadd364ae/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:15.410387 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93415c0-5f53-4396-b65e-3413f24b6a19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=642110d3da0540d88aec29535053de89, user_id=e63626b73eb545f79e7d9e3aadd364ae, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:15.413083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93415c0-5f53-4396-b65e-3413f24b6a19 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:15.521074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1201/2378] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:42:15 2022] PUT /identity/v3/projects/642110d3da0540d88aec29535053de89/users/e63626b73eb545f79e7d9e3aadd364ae/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:15.532971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ace290-a906-4a36-982f-8d550a01d2ed None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:15.533263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ace290-a906-4a36-982f-8d550a01d2ed None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:15.533544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ace290-a906-4a36-982f-8d550a01d2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:15.560681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b1ace290-a906-4a36-982f-8d550a01d2ed None None] MFA Rules not processed for user `e63626b73eb545f79e7d9e3aadd364ae`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:15.561883 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b1ace290-a906-4a36-982f-8d550a01d2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:15.638442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1178/2379] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:15.643296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93415c0-5f53-4396-b65e-3413f24b6a19 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:15.688349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:15.705578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93415c0-5f53-4396-b65e-3413f24b6a19 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:15.710241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a190986-d62e-4ff8-9997-ff907779b426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:15.710894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a190986-d62e-4ff8-9997-ff907779b426 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:15.711178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a190986-d62e-4ff8-9997-ff907779b426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:15.711453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a190986-d62e-4ff8-9997-ff907779b426 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:15.712138 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a190986-d62e-4ff8-9997-ff907779b426 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:15.714127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a190986-d62e-4ff8-9997-ff907779b426 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:15.830723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1202/2380] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:42:15 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:42:15.834876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ace290-a906-4a36-982f-8d550a01d2ed None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:15.845617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ace290-a906-4a36-982f-8d550a01d2ed None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:15.870516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:15.902484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b179a3-141d-41bc-ad4a-53d5326c53c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:15.903084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b179a3-141d-41bc-ad4a-53d5326c53c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:15.903366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b179a3-141d-41bc-ad4a-53d5326c53c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:15.903650 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b179a3-141d-41bc-ad4a-53d5326c53c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:15.904334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b179a3-141d-41bc-ad4a-53d5326c53c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:15.906296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b179a3-141d-41bc-ad4a-53d5326c53c5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:16.029306 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1179/2381] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:42:15 2022] POST /identity/v3/users => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:42:16.033422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a190986-d62e-4ff8-9997-ff907779b426 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:16.043617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a190986-d62e-4ff8-9997-ff907779b426 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:16.049591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a682-7633-4a51-bbdc-ac229ffd1de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:16.050292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a682-7633-4a51-bbdc-ac229ffd1de1 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:16.050574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a682-7633-4a51-bbdc-ac229ffd1de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:16.050845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d783a682-7633-4a51-bbdc-ac229ffd1de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:16.051618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783a682-7633-4a51-bbdc-ac229ffd1de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:16.053282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d783a682-7633-4a51-bbdc-ac229ffd1de1 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:16.064911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1203/2382] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:42:16.069299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b179a3-141d-41bc-ad4a-53d5326c53c5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:16.080440 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b179a3-141d-41bc-ad4a-53d5326c53c5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:16.085183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf1a96-eec9-4b76-8458-025a0c5336bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:16.086178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1a96-eec9-4b76-8458-025a0c5336bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:16.086542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1a96-eec9-4b76-8458-025a0c5336bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:16.086892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf1a96-eec9-4b76-8458-025a0c5336bc admin admin] PATH_INFO: `/v3/projects/ea960a17c6b0492691ecc5ea7c3c7b33/users/3c326fbe8a9c44eaa838a9ec62406b04/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:16.102392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf1a96-eec9-4b76-8458-025a0c5336bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea960a17c6b0492691ecc5ea7c3c7b33, user_id=3c326fbe8a9c44eaa838a9ec62406b04, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:16.105498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf1a96-eec9-4b76-8458-025a0c5336bc admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:16.218163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1180/2383] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:42:16 2022] PUT /identity/v3/projects/ea960a17c6b0492691ecc5ea7c3c7b33/users/3c326fbe8a9c44eaa838a9ec62406b04/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:16.222286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a682-7633-4a51-bbdc-ac229ffd1de1 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:16.232938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d783a682-7633-4a51-bbdc-ac229ffd1de1 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:16.288471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e825c-6a0e-43b4-8d37-7c054450e00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:16.289150 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e825c-6a0e-43b4-8d37-7c054450e00e admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:16.289427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e825c-6a0e-43b4-8d37-7c054450e00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:16.289715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e825c-6a0e-43b4-8d37-7c054450e00e admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:16.290405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e825c-6a0e-43b4-8d37-7c054450e00e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:16.292069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e825c-6a0e-43b4-8d37-7c054450e00e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:16.301602 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1204/2384] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:42:16.305701 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf1a96-eec9-4b76-8458-025a0c5336bc admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:16.315756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf1a96-eec9-4b76-8458-025a0c5336bc admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:16.320257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970841e-97f0-4aae-98e5-75236497b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:16.321178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970841e-97f0-4aae-98e5-75236497b6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:16.333903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970841e-97f0-4aae-98e5-75236497b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:16.333903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2970841e-97f0-4aae-98e5-75236497b6d4 admin admin] PATH_INFO: `/v3/projects/ea960a17c6b0492691ecc5ea7c3c7b33/users/3c326fbe8a9c44eaa838a9ec62406b04/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:16.333903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970841e-97f0-4aae-98e5-75236497b6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea960a17c6b0492691ecc5ea7c3c7b33, user_id=3c326fbe8a9c44eaa838a9ec62406b04, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:16.333903 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2970841e-97f0-4aae-98e5-75236497b6d4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:16.337098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1181/2385] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:42:16 2022] PUT /identity/v3/projects/ea960a17c6b0492691ecc5ea7c3c7b33/users/3c326fbe8a9c44eaa838a9ec62406b04/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:42:16.347668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9219323-8e74-4acc-9cfc-a588996c66b2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:16.347965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9219323-8e74-4acc-9cfc-a588996c66b2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:16.348248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9219323-8e74-4acc-9cfc-a588996c66b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:16.374373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b9219323-8e74-4acc-9cfc-a588996c66b2 None None] MFA Rules not processed for user `3c326fbe8a9c44eaa838a9ec62406b04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:16.375569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b9219323-8e74-4acc-9cfc-a588996c66b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:16.441341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1205/2386] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:16.452262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970841e-97f0-4aae-98e5-75236497b6d4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:16.453996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2970841e-97f0-4aae-98e5-75236497b6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:16.509759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2970841e-97f0-4aae-98e5-75236497b6d4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:16.514100 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcdc1b-f2cf-4602-9a6e-732c25287a3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:16.514729 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcdc1b-f2cf-4602-9a6e-732c25287a3c service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:16.515011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcdc1b-f2cf-4602-9a6e-732c25287a3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:16.515287 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdcdc1b-f2cf-4602-9a6e-732c25287a3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:16.524265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcdc1b-f2cf-4602-9a6e-732c25287a3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:16.525726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdcdc1b-f2cf-4602-9a6e-732c25287a3c service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:16.535773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1182/2387] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:16 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:42:16.634058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9219323-8e74-4acc-9cfc-a588996c66b2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:16.644444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9219323-8e74-4acc-9cfc-a588996c66b2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:16.648059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38405c7-d3e9-4e5c-83b3-08d3a392ff0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:16.648726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38405c7-d3e9-4e5c-83b3-08d3a392ff0e service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:16.649011 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38405c7-d3e9-4e5c-83b3-08d3a392ff0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:16.649288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38405c7-d3e9-4e5c-83b3-08d3a392ff0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:16.683792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:16.707090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38405c7-d3e9-4e5c-83b3-08d3a392ff0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:16.708428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38405c7-d3e9-4e5c-83b3-08d3a392ff0e service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:16.718181 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1206/2388] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:42:19.843748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcdc1b-f2cf-4602-9a6e-732c25287a3c service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:19.907582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdcdc1b-f2cf-4602-9a6e-732c25287a3c service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:19.912506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:19.913375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:19.913658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:19.914043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] PATH_INFO: `/v3/users/e63626b73eb545f79e7d9e3aadd364ae` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:19.915241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e63626b73eb545f79e7d9e3aadd364ae)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:19.917189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:19.941647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:20.141696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e63626b73eb545f79e7d9e3aadd364ae'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:20.148443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e63626b73eb545f79e7d9e3aadd364ae'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:20.149181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e63626b73eb545f79e7d9e3aadd364ae'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:20.161215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e63626b73eb545f79e7d9e3aadd364ae'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:20.161891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e63626b73eb545f79e7d9e3aadd364ae'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:20.263530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1183/2389] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:42:19 2022] DELETE /identity/v3/users/e63626b73eb545f79e7d9e3aadd364ae => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:20.268290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7412d-b849-4470-99db-7d0128dfef91 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:20.268787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7412d-b849-4470-99db-7d0128dfef91 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:20.268910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7412d-b849-4470-99db-7d0128dfef91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:20.286337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-07c7412d-b849-4470-99db-7d0128dfef91 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:20.287464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-07c7412d-b849-4470-99db-7d0128dfef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:20.346943 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1207/2390] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:20.357372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:20.358820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:20.415582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3ee5f7-7976-4775-b923-d5828df9a5cd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:20.420008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566146d3-d291-413a-8c3f-5c62007d3434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:20.420691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566146d3-d291-413a-8c3f-5c62007d3434 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:20.420971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566146d3-d291-413a-8c3f-5c62007d3434 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:20.421242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566146d3-d291-413a-8c3f-5c62007d3434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:20.430137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566146d3-d291-413a-8c3f-5c62007d3434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:20.431556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566146d3-d291-413a-8c3f-5c62007d3434 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:20.440859 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1184/2391] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:42:20.569639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7412d-b849-4470-99db-7d0128dfef91 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:20.570935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-07c7412d-b849-4470-99db-7d0128dfef91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:20.583655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7412d-b849-4470-99db-7d0128dfef91 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:20.587261 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf8d6c-1d06-49bc-acb2-f79e130e3936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:20.589538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf8d6c-1d06-49bc-acb2-f79e130e3936 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:20.589538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf8d6c-1d06-49bc-acb2-f79e130e3936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:20.589538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf8d6c-1d06-49bc-acb2-f79e130e3936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:20.590689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dacf8d6c-1d06-49bc-acb2-f79e130e3936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:20.601109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf8d6c-1d06-49bc-acb2-f79e130e3936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:20.602609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf8d6c-1d06-49bc-acb2-f79e130e3936 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:20.610826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1208/2392] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:20 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:42:20.878567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566146d3-d291-413a-8c3f-5c62007d3434 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:20.880022 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-566146d3-d291-413a-8c3f-5c62007d3434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:20.894813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566146d3-d291-413a-8c3f-5c62007d3434 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:20.900085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:20.900987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:20.901266 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:20.901539 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] PATH_INFO: `/v3/projects/642110d3da0540d88aec29535053de89` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:20.902752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=642110d3da0540d88aec29535053de89)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:20.905635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:21.020045 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '642110d3da0540d88aec29535053de89', 'request_id': 'req-77de07d5-5bc3-4de0-a342-a5d6eb74d948'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.026323 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '642110d3da0540d88aec29535053de89', 'request_id': 'req-77de07d5-5bc3-4de0-a342-a5d6eb74d948'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.035714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '642110d3da0540d88aec29535053de89', 'request_id': 'req-77de07d5-5bc3-4de0-a342-a5d6eb74d948'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.131531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] The token cache is being invalidate because project 642110d3da0540d88aec29535053de89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:42:21.131531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.131531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.131838 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1185/2393] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:42:20 2022] DELETE /identity/v3/projects/642110d3da0540d88aec29535053de89 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:21.135403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf8d6c-1d06-49bc-acb2-f79e130e3936 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:21.147632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf8d6c-1d06-49bc-acb2-f79e130e3936 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:21.204350 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:21.205256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:21.205544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:21.205820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] PATH_INFO: `/v3/users/3c326fbe8a9c44eaa838a9ec62406b04` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:21.207029 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c326fbe8a9c44eaa838a9ec62406b04)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:21.209002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:21.404243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c326fbe8a9c44eaa838a9ec62406b04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.410626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c326fbe8a9c44eaa838a9ec62406b04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.412403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:21.591446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c326fbe8a9c44eaa838a9ec62406b04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.592127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c326fbe8a9c44eaa838a9ec62406b04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.592792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bd34f0cc-1f43-4767-bba4-ce76132013f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c326fbe8a9c44eaa838a9ec62406b04'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:21.605413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1209/2394] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:42:21 2022] DELETE /identity/v3/users/3c326fbe8a9c44eaa838a9ec62406b04 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:22.313395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:22.315016 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:22.336726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77de07d5-5bc3-4de0-a342-a5d6eb74d948 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:22.374565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:22.407209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:22.408076 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:22.408362 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:22.408670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] PATH_INFO: `/v3/projects/ea960a17c6b0492691ecc5ea7c3c7b33` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:22.409896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea960a17c6b0492691ecc5ea7c3c7b33)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:22.411880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:22.522604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea960a17c6b0492691ecc5ea7c3c7b33', 'request_id': 'req-71c28a2d-4eed-4731-9141-cbf37a3f7096'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:22.529200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea960a17c6b0492691ecc5ea7c3c7b33', 'request_id': 'req-71c28a2d-4eed-4731-9141-cbf37a3f7096'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:22.534742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea960a17c6b0492691ecc5ea7c3c7b33', 'request_id': 'req-71c28a2d-4eed-4731-9141-cbf37a3f7096'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:22.653031 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] The token cache is being invalidate because project ea960a17c6b0492691ecc5ea7c3c7b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:42:22.654057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:22.654763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:22.656328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1186/2395] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:42:22 2022] DELETE /identity/v3/projects/ea960a17c6b0492691ecc5ea7c3c7b33 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:22.661211 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23477b8-dbdc-4c4c-bca6-7697956a3851 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:22.661672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23477b8-dbdc-4c4c-bca6-7697956a3851 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:22.661841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23477b8-dbdc-4c4c-bca6-7697956a3851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:22.668739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:22.670879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:22.680401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-d23477b8-dbdc-4c4c-bca6-7697956a3851 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:22.681885 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-d23477b8-dbdc-4c4c-bca6-7697956a3851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:22.743628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1210/2396] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:22.744138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c28a2d-4eed-4731-9141-cbf37a3f7096 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:22.749927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a05d1-3181-4636-8fed-9af9911bb52e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:22.750575 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a05d1-3181-4636-8fed-9af9911bb52e service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:22.750856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a05d1-3181-4636-8fed-9af9911bb52e service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:22.751134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a05d1-3181-4636-8fed-9af9911bb52e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:22.751697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb504088-289f-42d5-bd7d-887d5e7d9306 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:22.752075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb504088-289f-42d5-bd7d-887d5e7d9306 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:22.752409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb504088-289f-42d5-bd7d-887d5e7d9306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:22.752950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2b9a05d1-3181-4636-8fed-9af9911bb52e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:22.772913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cb504088-289f-42d5-bd7d-887d5e7d9306 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:22.774128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cb504088-289f-42d5-bd7d-887d5e7d9306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:22.782975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1211/2397] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:22.787601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb504088-289f-42d5-bd7d-887d5e7d9306 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:22.797341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb504088-289f-42d5-bd7d-887d5e7d9306 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:22.802267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cf65a-0e97-4058-b537-d8127732c3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:22.803018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf65a-0e97-4058-b537-d8127732c3fd admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:22.803421 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf65a-0e97-4058-b537-d8127732c3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:22.803928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cf65a-0e97-4058-b537-d8127732c3fd admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:22.804804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cf65a-0e97-4058-b537-d8127732c3fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:42:22.805111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cf65a-0e97-4058-b537-d8127732c3fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:22.806710 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cf65a-0e97-4058-b537-d8127732c3fd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:22.814673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a05d1-3181-4636-8fed-9af9911bb52e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:22.816769 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a05d1-3181-4636-8fed-9af9911bb52e service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:22.819473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1212/2398] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:42:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:42:22.823776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cf65a-0e97-4058-b537-d8127732c3fd admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:22.828057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1187/2399] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:42:22.836313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cf65a-0e97-4058-b537-d8127732c3fd admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:22.841328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb691a-2171-4210-a054-329baafb3f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:22.849661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb691a-2171-4210-a054-329baafb3f07 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:22.849661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb691a-2171-4210-a054-329baafb3f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:22.849661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb691a-2171-4210-a054-329baafb3f07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:22.849661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb691a-2171-4210-a054-329baafb3f07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:22.849661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eeb691a-2171-4210-a054-329baafb3f07 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:22.957376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1213/2400] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:42:22 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:42:22.958585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a05d1-3181-4636-8fed-9af9911bb52e service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:22.971146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a05d1-3181-4636-8fed-9af9911bb52e service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:23.031176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074876f-d3f0-4d9f-b570-0f19ee3fb0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:23.031855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074876f-d3f0-4d9f-b570-0f19ee3fb0ec admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.032139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074876f-d3f0-4d9f-b570-0f19ee3fb0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.032414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074876f-d3f0-4d9f-b570-0f19ee3fb0ec admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.033149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074876f-d3f0-4d9f-b570-0f19ee3fb0ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:23.035084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074876f-d3f0-4d9f-b570-0f19ee3fb0ec admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:23.046857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:23.190124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1188/2401] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:42:22 2022] POST /identity/v3/users => generated 290 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:42:23.193956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb691a-2171-4210-a054-329baafb3f07 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:23.204835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeb691a-2171-4210-a054-329baafb3f07 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:23.210109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3438d-1d73-45d6-8a3f-b3af248faad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:23.211082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3438d-1d73-45d6-8a3f-b3af248faad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.211472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3438d-1d73-45d6-8a3f-b3af248faad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.211827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b3438d-1d73-45d6-8a3f-b3af248faad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.212887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3438d-1d73-45d6-8a3f-b3af248faad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:23.214587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b3438d-1d73-45d6-8a3f-b3af248faad5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:23.226511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1214/2402] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:42:23.230574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074876f-d3f0-4d9f-b570-0f19ee3fb0ec admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:23.241411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074876f-d3f0-4d9f-b570-0f19ee3fb0ec admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:23.246388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c4c57-b4b8-4c41-9899-df57439d4926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:23.247060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4c57-b4b8-4c41-9899-df57439d4926 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.247345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4c57-b4b8-4c41-9899-df57439d4926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.247625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c4c57-b4b8-4c41-9899-df57439d4926 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.248356 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c4c57-b4b8-4c41-9899-df57439d4926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:23.250161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c4c57-b4b8-4c41-9899-df57439d4926 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:23.261342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1189/2403] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:42:23.266289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3438d-1d73-45d6-8a3f-b3af248faad5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:23.277199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b3438d-1d73-45d6-8a3f-b3af248faad5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:23.282597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae538f-3f42-4dbc-bcb6-fe8a848073e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:23.283610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae538f-3f42-4dbc-bcb6-fe8a848073e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.283891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae538f-3f42-4dbc-bcb6-fe8a848073e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.284157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae538f-3f42-4dbc-bcb6-fe8a848073e2 admin admin] PATH_INFO: `/v3/projects/72e9b9fcd8904dbb9d41e83cac2861db/users/e1ae0e50b59643e183520b71a93dffca/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.301914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae538f-3f42-4dbc-bcb6-fe8a848073e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72e9b9fcd8904dbb9d41e83cac2861db, user_id=e1ae0e50b59643e183520b71a93dffca, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:23.304953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aae538f-3f42-4dbc-bcb6-fe8a848073e2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:23.412735 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1215/2404] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:42:23 2022] PUT /identity/v3/projects/72e9b9fcd8904dbb9d41e83cac2861db/users/e1ae0e50b59643e183520b71a93dffca/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:42:23.424242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a68419-18fc-4193-b2ed-e9fef0a99183 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.426639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a68419-18fc-4193-b2ed-e9fef0a99183 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.426639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a68419-18fc-4193-b2ed-e9fef0a99183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.454393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-95a68419-18fc-4193-b2ed-e9fef0a99183 None None] MFA Rules not processed for user `e1ae0e50b59643e183520b71a93dffca`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:23.455631 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-95a68419-18fc-4193-b2ed-e9fef0a99183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:23.539757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1190/2405] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:23 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:42:23.545447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae538f-3f42-4dbc-bcb6-fe8a848073e2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:23.612276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae538f-3f42-4dbc-bcb6-fe8a848073e2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:23.617507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83bfe2-41dc-47e2-b62d-70548d4d9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:23.618187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83bfe2-41dc-47e2-b62d-70548d4d9836 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.618470 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83bfe2-41dc-47e2-b62d-70548d4d9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.618743 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83bfe2-41dc-47e2-b62d-70548d4d9836 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.619467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83bfe2-41dc-47e2-b62d-70548d4d9836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:23.621451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83bfe2-41dc-47e2-b62d-70548d4d9836 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:23.631506 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:23.747304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1216/2406] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:42:23 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:42:23.751481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a68419-18fc-4193-b2ed-e9fef0a99183 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:23.762529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a68419-18fc-4193-b2ed-e9fef0a99183 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:23.821927 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40517c4-ddf2-42c7-8da0-65a4467ed1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:23.822610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40517c4-ddf2-42c7-8da0-65a4467ed1cf admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.822893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40517c4-ddf2-42c7-8da0-65a4467ed1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.823168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40517c4-ddf2-42c7-8da0-65a4467ed1cf admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.823919 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40517c4-ddf2-42c7-8da0-65a4467ed1cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:23.826467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40517c4-ddf2-42c7-8da0-65a4467ed1cf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:23.834498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:23.874409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c474933-f2a0-4a70-bc8d-7ef31c69c59f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.874799 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c474933-f2a0-4a70-bc8d-7ef31c69c59f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.876152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c474933-f2a0-4a70-bc8d-7ef31c69c59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.893982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6c474933-f2a0-4a70-bc8d-7ef31c69c59f None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:23.895167 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6c474933-f2a0-4a70-bc8d-7ef31c69c59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:23.931659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1191/2407] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:42:23 2022] POST /identity/v3/users => generated 290 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:42:23.932995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40517c4-ddf2-42c7-8da0-65a4467ed1cf admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:23.944003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40517c4-ddf2-42c7-8da0-65a4467ed1cf admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:23.948665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3503a3c-1fdb-4b4c-ad4a-f39f40deb77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:23.949400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3503a3c-1fdb-4b4c-ad4a-f39f40deb77a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.949808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3503a3c-1fdb-4b4c-ad4a-f39f40deb77a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.950869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3503a3c-1fdb-4b4c-ad4a-f39f40deb77a admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.951452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1217/2408] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:42:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:42:23.951592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3503a3c-1fdb-4b4c-ad4a-f39f40deb77a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:23.953254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3503a3c-1fdb-4b4c-ad4a-f39f40deb77a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:23.967160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1192/2409] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:42:23.967334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c474933-f2a0-4a70-bc8d-7ef31c69c59f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:23.967334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6c474933-f2a0-4a70-bc8d-7ef31c69c59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:23.967994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3503a3c-1fdb-4b4c-ad4a-f39f40deb77a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:23.977403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3503a3c-1fdb-4b4c-ad4a-f39f40deb77a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:23.982521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1770ce-c8fd-43eb-a0fb-0c8c325e0aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:23.983163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1770ce-c8fd-43eb-a0fb-0c8c325e0aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:23.983443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1770ce-c8fd-43eb-a0fb-0c8c325e0aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:23.983714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1770ce-c8fd-43eb-a0fb-0c8c325e0aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:23.984520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1770ce-c8fd-43eb-a0fb-0c8c325e0aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:23.986108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1770ce-c8fd-43eb-a0fb-0c8c325e0aa5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:23.999089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1193/2410] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:42:24.005120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1770ce-c8fd-43eb-a0fb-0c8c325e0aa5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:24.015926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1770ce-c8fd-43eb-a0fb-0c8c325e0aa5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:24.020348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd123bc5-9ab6-4790-aea3-798bd3f0607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:24.021245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd123bc5-9ab6-4790-aea3-798bd3f0607d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:24.021530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd123bc5-9ab6-4790-aea3-798bd3f0607d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:24.021813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd123bc5-9ab6-4790-aea3-798bd3f0607d admin admin] PATH_INFO: `/v3/projects/89026d935d5f4688be095c6619ea1993/users/9d71eb0b060e43c8b3776a4c725a8c8a/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:24.037093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c474933-f2a0-4a70-bc8d-7ef31c69c59f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:24.037276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd123bc5-9ab6-4790-aea3-798bd3f0607d admin admin] RBAC: Authorizing `identity:create_grant(project_id=89026d935d5f4688be095c6619ea1993, user_id=9d71eb0b060e43c8b3776a4c725a8c8a, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:24.039800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd123bc5-9ab6-4790-aea3-798bd3f0607d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:24.042249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6616c4-6611-46a1-8556-f4351f51e0b3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:24.042893 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6616c4-6611-46a1-8556-f4351f51e0b3 service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:24.043172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6616c4-6611-46a1-8556-f4351f51e0b3 service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:24.043447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6616c4-6611-46a1-8556-f4351f51e0b3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:24.052020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6616c4-6611-46a1-8556-f4351f51e0b3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:24.053635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6616c4-6611-46a1-8556-f4351f51e0b3 service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:24.062081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1218/2411] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:42:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 07:42:24.144101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1194/2412] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:42:24 2022] PUT /identity/v3/projects/89026d935d5f4688be095c6619ea1993/users/9d71eb0b060e43c8b3776a4c725a8c8a/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:42:24.154373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f406f-8ac5-4c5a-b741-bb6cc203be09 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:24.154655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f406f-8ac5-4c5a-b741-bb6cc203be09 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:24.154933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f406f-8ac5-4c5a-b741-bb6cc203be09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:24.181525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b19f406f-8ac5-4c5a-b741-bb6cc203be09 None None] MFA Rules not processed for user `9d71eb0b060e43c8b3776a4c725a8c8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:24.182756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b19f406f-8ac5-4c5a-b741-bb6cc203be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:24.253024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1219/2413] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:24.258310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd123bc5-9ab6-4790-aea3-798bd3f0607d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:24.339968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd123bc5-9ab6-4790-aea3-798bd3f0607d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:24.346386 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983b76a-b2fe-49bb-a235-1fe5923b69f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:24.347492 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983b76a-b2fe-49bb-a235-1fe5923b69f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:24.347967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983b76a-b2fe-49bb-a235-1fe5923b69f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:24.348346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983b76a-b2fe-49bb-a235-1fe5923b69f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:24.349371 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983b76a-b2fe-49bb-a235-1fe5923b69f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:24.352205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983b76a-b2fe-49bb-a235-1fe5923b69f3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:24.463476 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1195/2414] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:42:24 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:42:24.466533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f406f-8ac5-4c5a-b741-bb6cc203be09 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:24.491385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f406f-8ac5-4c5a-b741-bb6cc203be09 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:24.509791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:24.596549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e55334-3b81-473c-95c6-1da012fe748e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:24.597254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e55334-3b81-473c-95c6-1da012fe748e admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:24.597538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e55334-3b81-473c-95c6-1da012fe748e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:24.597817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e55334-3b81-473c-95c6-1da012fe748e admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:24.598540 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e55334-3b81-473c-95c6-1da012fe748e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:24.600786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e55334-3b81-473c-95c6-1da012fe748e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:24.735287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1220/2415] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:42:24 2022] POST /identity/v3/users => generated 296 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:42:24.739938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983b76a-b2fe-49bb-a235-1fe5923b69f3 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:24.758028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983b76a-b2fe-49bb-a235-1fe5923b69f3 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:24.763364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c6d4f-30dc-4bd3-a49f-60a39829f16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:24.764158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c6d4f-30dc-4bd3-a49f-60a39829f16a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:24.764586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c6d4f-30dc-4bd3-a49f-60a39829f16a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:24.764960 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587c6d4f-30dc-4bd3-a49f-60a39829f16a admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:24.765792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c6d4f-30dc-4bd3-a49f-60a39829f16a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:24.767510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587c6d4f-30dc-4bd3-a49f-60a39829f16a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:24.789640 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1196/2416] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:42:24.795488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e55334-3b81-473c-95c6-1da012fe748e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:24.806645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e55334-3b81-473c-95c6-1da012fe748e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:24.821723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf10d98-1164-49ab-8bce-f2358c54f8c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:24.822668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf10d98-1164-49ab-8bce-f2358c54f8c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:24.822973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf10d98-1164-49ab-8bce-f2358c54f8c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:24.823249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf10d98-1164-49ab-8bce-f2358c54f8c5 admin admin] PATH_INFO: `/v3/projects/f800468da46743eb8d509a9adf16daaf/users/2a685488810c423a9521615e5db69ce0/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:24.843781 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf10d98-1164-49ab-8bce-f2358c54f8c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f800468da46743eb8d509a9adf16daaf, user_id=2a685488810c423a9521615e5db69ce0, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:24.860600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf10d98-1164-49ab-8bce-f2358c54f8c5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:24.940651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1221/2417] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:42:24 2022] PUT /identity/v3/projects/f800468da46743eb8d509a9adf16daaf/users/2a685488810c423a9521615e5db69ce0/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:24.944434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c6d4f-30dc-4bd3-a49f-60a39829f16a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:24.956086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587c6d4f-30dc-4bd3-a49f-60a39829f16a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:25.025477 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09283df0-47b9-4bb4-b74b-e62568f768b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:25.026073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09283df0-47b9-4bb4-b74b-e62568f768b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:25.026357 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09283df0-47b9-4bb4-b74b-e62568f768b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:25.026629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09283df0-47b9-4bb4-b74b-e62568f768b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:25.027360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09283df0-47b9-4bb4-b74b-e62568f768b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:25.029874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09283df0-47b9-4bb4-b74b-e62568f768b6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:25.040432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1197/2418] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:24 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:42:25.045422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf10d98-1164-49ab-8bce-f2358c54f8c5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:25.056114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf10d98-1164-49ab-8bce-f2358c54f8c5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:25.061293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1718972-be08-442d-a978-ebe5c40080ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:25.062275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1718972-be08-442d-a978-ebe5c40080ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:25.062666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1718972-be08-442d-a978-ebe5c40080ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:25.063006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1718972-be08-442d-a978-ebe5c40080ec admin admin] PATH_INFO: `/v3/projects/f800468da46743eb8d509a9adf16daaf/users/2a685488810c423a9521615e5db69ce0/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:25.065279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1718972-be08-442d-a978-ebe5c40080ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=f800468da46743eb8d509a9adf16daaf, user_id=2a685488810c423a9521615e5db69ce0, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:25.068041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1718972-be08-442d-a978-ebe5c40080ec admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:25.079791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1222/2419] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:42:25 2022] PUT /identity/v3/projects/f800468da46743eb8d509a9adf16daaf/users/2a685488810c423a9521615e5db69ce0/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:25.098692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faef27-07e4-4b09-841d-c21419f8720d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:25.099108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faef27-07e4-4b09-841d-c21419f8720d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:25.099489 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faef27-07e4-4b09-841d-c21419f8720d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:25.130130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b0faef27-07e4-4b09-841d-c21419f8720d None None] MFA Rules not processed for user `2a685488810c423a9521615e5db69ce0`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:25.150013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b0faef27-07e4-4b09-841d-c21419f8720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:25.150013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:25.205170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1198/2420] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:25 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:42:25.217794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1718972-be08-442d-a978-ebe5c40080ec admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:25.219670 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f1718972-be08-442d-a978-ebe5c40080ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:25.283940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1718972-be08-442d-a978-ebe5c40080ec admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:25.287598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b02f7b-9887-4e4d-be81-bd2cacce3319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:25.288285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b02f7b-9887-4e4d-be81-bd2cacce3319 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:25.288589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b02f7b-9887-4e4d-be81-bd2cacce3319 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:25.288864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b02f7b-9887-4e4d-be81-bd2cacce3319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:25.298478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b02f7b-9887-4e4d-be81-bd2cacce3319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:25.299935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b02f7b-9887-4e4d-be81-bd2cacce3319 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:25.311889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1223/2421] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:25 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:42:25.452301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faef27-07e4-4b09-841d-c21419f8720d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:25.454167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b0faef27-07e4-4b09-841d-c21419f8720d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:25.469239 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faef27-07e4-4b09-841d-c21419f8720d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:25.474000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d94d00a-3547-447d-8c62-e04451721b35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:25.474874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94d00a-3547-447d-8c62-e04451721b35 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:25.475162 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94d00a-3547-447d-8c62-e04451721b35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:25.475446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d94d00a-3547-447d-8c62-e04451721b35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:25.540450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94d00a-3547-447d-8c62-e04451721b35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:25.541829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d94d00a-3547-447d-8c62-e04451721b35 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:25.551273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1199/2422] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:42:29.788944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b02f7b-9887-4e4d-be81-bd2cacce3319 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:29.869986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b02f7b-9887-4e4d-be81-bd2cacce3319 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:29.875149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:29.876031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:29.876319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:29.876642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] PATH_INFO: `/v3/users/e1ae0e50b59643e183520b71a93dffca` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:29.877855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ae0e50b59643e183520b71a93dffca)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:29.879804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:29.894096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:30.099053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ae0e50b59643e183520b71a93dffca'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:30.118993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ae0e50b59643e183520b71a93dffca'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:30.202428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ae0e50b59643e183520b71a93dffca'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:30.203154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ae0e50b59643e183520b71a93dffca'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:30.203777 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ae0e50b59643e183520b71a93dffca'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:30.218933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1224/2423] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:42:29 2022] DELETE /identity/v3/users/e1ae0e50b59643e183520b71a93dffca => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:30.223426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c17b8-b4d4-4e80-aec8-2661331ffbb9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:30.223993 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c17b8-b4d4-4e80-aec8-2661331ffbb9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:30.224233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931c17b8-b4d4-4e80-aec8-2661331ffbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:30.243375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-931c17b8-b4d4-4e80-aec8-2661331ffbb9 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:30.244724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-931c17b8-b4d4-4e80-aec8-2661331ffbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:30.319848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1200/2424] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:42:30.330050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:30.331468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:30.400190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501e80f-4542-46ea-a754-85fa92b12fd3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:30.405358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de241b-430f-44c0-9b9c-c3885d9cefbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:30.406122 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de241b-430f-44c0-9b9c-c3885d9cefbf service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:30.406433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de241b-430f-44c0-9b9c-c3885d9cefbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:30.406876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33de241b-430f-44c0-9b9c-c3885d9cefbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:30.417103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de241b-430f-44c0-9b9c-c3885d9cefbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:30.420262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33de241b-430f-44c0-9b9c-c3885d9cefbf service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:30.432800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1225/2425] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:42:31.227314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c17b8-b4d4-4e80-aec8-2661331ffbb9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:31.230473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-931c17b8-b4d4-4e80-aec8-2661331ffbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:31.243106 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931c17b8-b4d4-4e80-aec8-2661331ffbb9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:31.248999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:31.249898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:31.250185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:31.250473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] PATH_INFO: `/v3/projects/72e9b9fcd8904dbb9d41e83cac2861db` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:31.252136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72e9b9fcd8904dbb9d41e83cac2861db)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:31.253797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:31.365075 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:31.375061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72e9b9fcd8904dbb9d41e83cac2861db', 'request_id': 'req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.381464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72e9b9fcd8904dbb9d41e83cac2861db', 'request_id': 'req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.386989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72e9b9fcd8904dbb9d41e83cac2861db', 'request_id': 'req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.452215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] The token cache is being invalidate because project 72e9b9fcd8904dbb9d41e83cac2861db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:42:31.452562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.453297 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.455111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1201/2426] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:42:31 2022] DELETE /identity/v3/projects/72e9b9fcd8904dbb9d41e83cac2861db => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:31.459461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de241b-430f-44c0-9b9c-c3885d9cefbf service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:31.472527 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33de241b-430f-44c0-9b9c-c3885d9cefbf service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:31.535565 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:31.536825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:31.537284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:31.537796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] PATH_INFO: `/v3/users/9d71eb0b060e43c8b3776a4c725a8c8a` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:31.539425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d71eb0b060e43c8b3776a4c725a8c8a)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:31.541669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:31.699039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:31.710942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d71eb0b060e43c8b3776a4c725a8c8a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.725551 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d71eb0b060e43c8b3776a4c725a8c8a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.811309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d71eb0b060e43c8b3776a4c725a8c8a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.812087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d71eb0b060e43c8b3776a4c725a8c8a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.812791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d71eb0b060e43c8b3776a4c725a8c8a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:31.827750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1226/2427] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:42:31 2022] DELETE /identity/v3/users/9d71eb0b060e43c8b3776a4c725a8c8a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:32.327713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:32.329190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:32.346583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c85d7-2982-4302-a9c7-aad5b027a6b4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:32.404658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:32.408180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:32.408180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:32.408180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] PATH_INFO: `/v3/projects/89026d935d5f4688be095c6619ea1993` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:32.408180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89026d935d5f4688be095c6619ea1993)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:32.409214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:32.517614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89026d935d5f4688be095c6619ea1993', 'request_id': 'req-e07253ed-ac3b-440c-b762-5287594f7763'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:32.524081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89026d935d5f4688be095c6619ea1993', 'request_id': 'req-e07253ed-ac3b-440c-b762-5287594f7763'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:32.532212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89026d935d5f4688be095c6619ea1993', 'request_id': 'req-e07253ed-ac3b-440c-b762-5287594f7763'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:32.611698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] The token cache is being invalidate because project 89026d935d5f4688be095c6619ea1993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:42:32.616446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:32.616446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:32.616446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1202/2428] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:42:32 2022] DELETE /identity/v3/projects/89026d935d5f4688be095c6619ea1993 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:32.618666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:32.620066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:32.634444 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4587e1ec-8a3b-4abd-a671-a54b485e4ebb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:32.690501 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:32.691374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:32.691657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:32.691929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] PATH_INFO: `/v3/users/2a685488810c423a9521615e5db69ce0` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:32.693105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a685488810c423a9521615e5db69ce0)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:32.695061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:32.919314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a685488810c423a9521615e5db69ce0'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:32.937514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a685488810c423a9521615e5db69ce0'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:33.019733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a685488810c423a9521615e5db69ce0'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:33.020502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a685488810c423a9521615e5db69ce0'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:33.021131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1fd05520-e16e-4ace-9cc9-aaacb685a21f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a685488810c423a9521615e5db69ce0'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:33.037191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1227/2429] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:42:32 2022] DELETE /identity/v3/users/2a685488810c423a9521615e5db69ce0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:42:33.547819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:33.549271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:33.563132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07253ed-ac3b-440c-b762-5287594f7763 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:33.617785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:33.627201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:33.631314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:33.631314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:33.631314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] PATH_INFO: `/v3/projects/f800468da46743eb8d509a9adf16daaf` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:33.631314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] RBAC: Authorizing `identity:delete_project(project_id=f800468da46743eb8d509a9adf16daaf)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:33.631893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:33.788376 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f800468da46743eb8d509a9adf16daaf', 'request_id': 'req-bea0db71-f087-4967-ab23-ef137ffd09af'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:33.795074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f800468da46743eb8d509a9adf16daaf', 'request_id': 'req-bea0db71-f087-4967-ab23-ef137ffd09af'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:33.800506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f800468da46743eb8d509a9adf16daaf', 'request_id': 'req-bea0db71-f087-4967-ab23-ef137ffd09af'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:33.928979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] The token cache is being invalidate because project f800468da46743eb8d509a9adf16daaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:42:33.929271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:33.929912 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-bea0db71-f087-4967-ab23-ef137ffd09af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:42:33.931789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1203/2430] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:42:33 2022] DELETE /identity/v3/projects/f800468da46743eb8d509a9adf16daaf => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:42:33.938131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7af11-6aab-45e0-83fb-2702d5fca79e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:33.938725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7af11-6aab-45e0-83fb-2702d5fca79e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:33.938725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a7af11-6aab-45e0-83fb-2702d5fca79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:33.960849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-70a7af11-6aab-45e0-83fb-2702d5fca79e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:33.962313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-70a7af11-6aab-45e0-83fb-2702d5fca79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:33.989516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:34.023449 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1228/2431] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:34.032049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b71eb-8d9a-4ecc-a552-311ee6c9f7d8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:34.032342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b71eb-8d9a-4ecc-a552-311ee6c9f7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:34.032653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059b71eb-8d9a-4ecc-a552-311ee6c9f7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:34.052125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-059b71eb-8d9a-4ecc-a552-311ee6c9f7d8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:34.053298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-059b71eb-8d9a-4ecc-a552-311ee6c9f7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:34.069781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1204/2432] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:42:34.069992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7af11-6aab-45e0-83fb-2702d5fca79e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:34.079878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a7af11-6aab-45e0-83fb-2702d5fca79e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:34.085811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd92b7-d3cb-451b-9a32-2f259d49a2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:34.086676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd92b7-d3cb-451b-9a32-2f259d49a2d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:34.087015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd92b7-d3cb-451b-9a32-2f259d49a2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:34.087291 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fd92b7-d3cb-451b-9a32-2f259d49a2d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:34.088050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd92b7-d3cb-451b-9a32-2f259d49a2d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:42:34.088355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd92b7-d3cb-451b-9a32-2f259d49a2d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:34.094397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fd92b7-d3cb-451b-9a32-2f259d49a2d4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:34.104516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1229/2433] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:42:34.107824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b71eb-8d9a-4ecc-a552-311ee6c9f7d8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:34.118371 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059b71eb-8d9a-4ecc-a552-311ee6c9f7d8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:34.124195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8aec7-16a6-44c5-94f8-10333c64197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:34.124917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8aec7-16a6-44c5-94f8-10333c64197b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:34.125931 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8aec7-16a6-44c5-94f8-10333c64197b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:34.126256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8aec7-16a6-44c5-94f8-10333c64197b admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:34.126974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8aec7-16a6-44c5-94f8-10333c64197b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:34.129023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8aec7-16a6-44c5-94f8-10333c64197b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:34.258992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1205/2434] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:42:34 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:42:34.263409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd92b7-d3cb-451b-9a32-2f259d49a2d4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:34.273561 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fd92b7-d3cb-451b-9a32-2f259d49a2d4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:34.330759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535c955-b665-4f63-b7f8-8a98e3d67e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:34.331365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535c955-b665-4f63-b7f8-8a98e3d67e50 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:34.331648 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535c955-b665-4f63-b7f8-8a98e3d67e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:34.331926 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c535c955-b665-4f63-b7f8-8a98e3d67e50 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:34.332662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535c955-b665-4f63-b7f8-8a98e3d67e50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:34.334638 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c535c955-b665-4f63-b7f8-8a98e3d67e50 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:34.416300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1230/2435] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:42:34 2022] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:42:34.418353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8aec7-16a6-44c5-94f8-10333c64197b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:34.429733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8aec7-16a6-44c5-94f8-10333c64197b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:34.435102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76a77-8e8b-47dd-b618-28ee9d4244dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:34.436039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76a77-8e8b-47dd-b618-28ee9d4244dd admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:34.436322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76a77-8e8b-47dd-b618-28ee9d4244dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:34.436642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba76a77-8e8b-47dd-b618-28ee9d4244dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:34.437382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba76a77-8e8b-47dd-b618-28ee9d4244dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:34.438976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba76a77-8e8b-47dd-b618-28ee9d4244dd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:34.449810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1206/2436] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:42:34.453835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535c955-b665-4f63-b7f8-8a98e3d67e50 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:34.463849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c535c955-b665-4f63-b7f8-8a98e3d67e50 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:34.468452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d60c3d-4b61-4634-b196-a8b9f7f9557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:34.469146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d60c3d-4b61-4634-b196-a8b9f7f9557b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:34.469432 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d60c3d-4b61-4634-b196-a8b9f7f9557b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:34.469708 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d60c3d-4b61-4634-b196-a8b9f7f9557b admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:34.470425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d60c3d-4b61-4634-b196-a8b9f7f9557b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:34.472024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d60c3d-4b61-4634-b196-a8b9f7f9557b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:34.482467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1231/2437] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:42:34.486819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76a77-8e8b-47dd-b618-28ee9d4244dd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:34.497673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba76a77-8e8b-47dd-b618-28ee9d4244dd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:34.502419 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b1ae-c082-4564-8640-038d50371738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:34.503310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b1ae-c082-4564-8640-038d50371738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:34.503598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b1ae-c082-4564-8640-038d50371738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:34.503879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f8b1ae-c082-4564-8640-038d50371738 admin admin] PATH_INFO: `/v3/projects/c16634316fc64493aef03cf073514273/users/c92e8b7fc090454c9498afef1d79e4bc/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:34.518874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8b1ae-c082-4564-8640-038d50371738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c16634316fc64493aef03cf073514273, user_id=c92e8b7fc090454c9498afef1d79e4bc, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:34.521615 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f8b1ae-c082-4564-8640-038d50371738 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:34.658779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1207/2438] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:42:34 2022] PUT /identity/v3/projects/c16634316fc64493aef03cf073514273/users/c92e8b7fc090454c9498afef1d79e4bc/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:42:34.663702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fafb2-086d-4bb5-8ce5-670eb015b6a0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:34.663992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fafb2-086d-4bb5-8ce5-670eb015b6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:34.664268 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fafb2-086d-4bb5-8ce5-670eb015b6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:34.682836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-036fafb2-086d-4bb5-8ce5-670eb015b6a0 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:34.684202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-036fafb2-086d-4bb5-8ce5-670eb015b6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:34.746129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1232/2439] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:34.755934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b1ae-c082-4564-8640-038d50371738 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:34.757760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f0f8b1ae-c082-4564-8640-038d50371738 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:34.819780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f8b1ae-c082-4564-8640-038d50371738 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:34.824644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a94dd-15b0-4dc7-bb8b-452d998dfb65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:34.825548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a94dd-15b0-4dc7-bb8b-452d998dfb65 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:34.825862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a94dd-15b0-4dc7-bb8b-452d998dfb65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:34.826140 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a94dd-15b0-4dc7-bb8b-452d998dfb65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:34.836124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a94dd-15b0-4dc7-bb8b-452d998dfb65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:34.837690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a94dd-15b0-4dc7-bb8b-452d998dfb65 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:34.848801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1208/2440] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:42:37.415047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a74f-6307-47ef-ad86-f1d07f842bd0 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:37.415594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a74f-6307-47ef-ad86-f1d07f842bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:37.415687 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89a74f-6307-47ef-ad86-f1d07f842bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:37.446337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ec89a74f-6307-47ef-ad86-f1d07f842bd0 None None] MFA Rules not processed for user `c92e8b7fc090454c9498afef1d79e4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:37.447623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ec89a74f-6307-47ef-ad86-f1d07f842bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:37.474817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:37.518245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1233/2441] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:37.529050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a94dd-15b0-4dc7-bb8b-452d998dfb65 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:37.530475 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0f5a94dd-15b0-4dc7-bb8b-452d998dfb65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:37.558726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:37.592670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a94dd-15b0-4dc7-bb8b-452d998dfb65 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:37.596428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea63ad-d201-485a-84b4-1ab71b23bfa3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:37.597126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea63ad-d201-485a-84b4-1ab71b23bfa3 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:37.597421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea63ad-d201-485a-84b4-1ab71b23bfa3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:37.597705 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea63ad-d201-485a-84b4-1ab71b23bfa3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:37.607176 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea63ad-d201-485a-84b4-1ab71b23bfa3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:37.608683 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea63ad-d201-485a-84b4-1ab71b23bfa3 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:37.617812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1209/2442] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:42:38.615066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528efff4-8631-44b7-ad5c-ea2f6b4f8ce8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:38.615538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528efff4-8631-44b7-ad5c-ea2f6b4f8ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:38.615637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528efff4-8631-44b7-ad5c-ea2f6b4f8ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:38.634259 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-528efff4-8631-44b7-ad5c-ea2f6b4f8ce8 None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:38.635452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-528efff4-8631-44b7-ad5c-ea2f6b4f8ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:38.695559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1234/2443] 10.222.0.24 () {58 vars in 967 bytes} [Wed May 25 07:42:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:38.707721 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea63ad-d201-485a-84b4-1ab71b23bfa3 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:38.709159 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-fdea63ad-d201-485a-84b4-1ab71b23bfa3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:38.777802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea63ad-d201-485a-84b4-1ab71b23bfa3 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:38.783168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040b83a-19cf-423f-9b07-1fa584b2ca6c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:38.783820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b83a-19cf-423f-9b07-1fa584b2ca6c service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:38.784103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b83a-19cf-423f-9b07-1fa584b2ca6c service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:38.784375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8040b83a-19cf-423f-9b07-1fa584b2ca6c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:38.792826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040b83a-19cf-423f-9b07-1fa584b2ca6c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:38.799195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8040b83a-19cf-423f-9b07-1fa584b2ca6c service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:38.802793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1210/2444] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:42:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 07:42:39.523376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbaae-bfa9-4d61-b816-6b1ebc6a74e6 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:39.523666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbaae-bfa9-4d61-b816-6b1ebc6a74e6 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:39.523947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ccbaae-bfa9-4d61-b816-6b1ebc6a74e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:39.543795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-95ccbaae-bfa9-4d61-b816-6b1ebc6a74e6 None None] MFA Rules not processed for user `c92e8b7fc090454c9498afef1d79e4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:39.545608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-95ccbaae-bfa9-4d61-b816-6b1ebc6a74e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:39.552798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1235/2445] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:42:45.773660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040b83a-19cf-423f-9b07-1fa584b2ca6c service swift] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:42:45.775272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8040b83a-19cf-423f-9b07-1fa584b2ca6c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:45.862454 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8040b83a-19cf-423f-9b07-1fa584b2ca6c service swift] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:42:45.870891 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:42:45.871654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:45.872027 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:45.872364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:45.878421 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:45.896556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:42:45.900097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:42:45.916879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1211/2446] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:42:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:42:49.538071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=43 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:55.917185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=82 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:57.973715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f7e13-f446-4109-97d2-bc262e16d61e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:42:57.974276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f7e13-f446-4109-97d2-bc262e16d61e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:42:57.974447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f7e13-f446-4109-97d2-bc262e16d61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:42:57.993150 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-317f7e13-f446-4109-97d2-bc262e16d61e None None] MFA Rules not processed for user `c92e8b7fc090454c9498afef1d79e4bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:42:57.994372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-317f7e13-f446-4109-97d2-bc262e16d61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:42:58.001588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1236/2447] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:42:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:07.987583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:15.458539 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:15.460008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:15.480245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d12fa-a549-4b87-8084-7c57985148c0 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:15.480245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:15.480245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:15.480245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:15.480695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:15.480695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:15.494163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:15.495618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:15.507044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1212/2448] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:17.822649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f7e13-f446-4109-97d2-bc262e16d61e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:17.833682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f7e13-f446-4109-97d2-bc262e16d61e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:17.838328 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10101d-1f88-47b4-9f43-b164a11b82eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:17.839095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10101d-1f88-47b4-9f43-b164a11b82eb service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:17.839505 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10101d-1f88-47b4-9f43-b164a11b82eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:17.839880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10101d-1f88-47b4-9f43-b164a11b82eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:17.842865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3e10101d-1f88-47b4-9f43-b164a11b82eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:17.859112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10101d-1f88-47b4-9f43-b164a11b82eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:17.861159 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10101d-1f88-47b4-9f43-b164a11b82eb service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:17.874316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1237/2449] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:19.906834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:19.910592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:19.932850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1573ee1-e763-4a43-ba29-ac764ee228c6 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:19.938735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:19.942946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:19.943425 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:19.943888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] PATH_INFO: `/v3/users/0487ea9076ee4baf8138fdc25ce02522` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:19.946504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0487ea9076ee4baf8138fdc25ce02522)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:19.948411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:20.225687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0487ea9076ee4baf8138fdc25ce02522'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:20.238489 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0487ea9076ee4baf8138fdc25ce02522'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:20.241050 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0487ea9076ee4baf8138fdc25ce02522'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:20.260581 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0487ea9076ee4baf8138fdc25ce02522'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:20.261566 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-fc1b7d7d-7660-49b0-8d31-1a8a23f88de9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0487ea9076ee4baf8138fdc25ce02522'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:20.369423 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1213/2450] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:19 2022] DELETE /identity/v3/users/0487ea9076ee4baf8138fdc25ce02522 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:20.680335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10101d-1f88-47b4-9f43-b164a11b82eb service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:20.697401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10101d-1f88-47b4-9f43-b164a11b82eb service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:20.831514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:20.832640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:20.833081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:20.833748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] PATH_INFO: `/v3/projects/2d8e35800ce043acbcb027ce406ed2e7` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:20.835335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8e35800ce043acbcb027ce406ed2e7)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:20.837737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:21.004414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8e35800ce043acbcb027ce406ed2e7', 'request_id': 'req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:21.017593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8e35800ce043acbcb027ce406ed2e7', 'request_id': 'req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:21.024172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8e35800ce043acbcb027ce406ed2e7', 'request_id': 'req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:21.144905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] The token cache is being invalidate because project 2d8e35800ce043acbcb027ce406ed2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:21.145325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:21.146224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f73fbdd8-543c-4e7a-8a3a-1f1bc50a8bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:21.149711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1238/2451] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:20 2022] DELETE /identity/v3/projects/2d8e35800ce043acbcb027ce406ed2e7 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:21.157822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48680f80-1df6-410d-96a3-11b0f1a59eb7 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:21.158237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48680f80-1df6-410d-96a3-11b0f1a59eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:21.158411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48680f80-1df6-410d-96a3-11b0f1a59eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:21.186096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-48680f80-1df6-410d-96a3-11b0f1a59eb7 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:21.187601 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-48680f80-1df6-410d-96a3-11b0f1a59eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:21.290806 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1214/2452] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:21.299730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016e132-3ae9-496e-a06e-8c917ebbfc67 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:21.300253 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016e132-3ae9-496e-a06e-8c917ebbfc67 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:21.300762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016e132-3ae9-496e-a06e-8c917ebbfc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:21.334768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9016e132-3ae9-496e-a06e-8c917ebbfc67 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:21.336304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9016e132-3ae9-496e-a06e-8c917ebbfc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:21.355727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1239/2453] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:21.361223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48680f80-1df6-410d-96a3-11b0f1a59eb7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:21.374442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48680f80-1df6-410d-96a3-11b0f1a59eb7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:21.380731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91658a-1725-47c3-82a0-edd37f371ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:21.381743 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91658a-1725-47c3-82a0-edd37f371ec7 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:21.382247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91658a-1725-47c3-82a0-edd37f371ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:21.382798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b91658a-1725-47c3-82a0-edd37f371ec7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:21.383793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91658a-1725-47c3-82a0-edd37f371ec7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:21.384331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91658a-1725-47c3-82a0-edd37f371ec7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:21.386186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b91658a-1725-47c3-82a0-edd37f371ec7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:21.408405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1215/2454] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:43:21.409645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016e132-3ae9-496e-a06e-8c917ebbfc67 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:21.419053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016e132-3ae9-496e-a06e-8c917ebbfc67 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:21.424557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0878d-e4eb-42a3-b104-553a98f7802f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:21.425310 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0878d-e4eb-42a3-b104-553a98f7802f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:21.427906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0878d-e4eb-42a3-b104-553a98f7802f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:21.427906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad0878d-e4eb-42a3-b104-553a98f7802f admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:21.427906 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0878d-e4eb-42a3-b104-553a98f7802f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:21.428442 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad0878d-e4eb-42a3-b104-553a98f7802f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:21.578839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1240/2455] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:21 2022] POST /identity/v3/projects => generated 393 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:43:21.588467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91658a-1725-47c3-82a0-edd37f371ec7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:21.607976 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b91658a-1725-47c3-82a0-edd37f371ec7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:21.662753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:21.678892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bd5b5-1da3-498e-99c3-2a4418148bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:21.679703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd5b5-1da3-498e-99c3-2a4418148bc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:21.685849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd5b5-1da3-498e-99c3-2a4418148bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:21.685849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28bd5b5-1da3-498e-99c3-2a4418148bc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:21.685849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bd5b5-1da3-498e-99c3-2a4418148bc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:21.685849 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28bd5b5-1da3-498e-99c3-2a4418148bc0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:21.827909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1216/2456] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:21 2022] POST /identity/v3/users => generated 297 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:21.829208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0878d-e4eb-42a3-b104-553a98f7802f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:21.840994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad0878d-e4eb-42a3-b104-553a98f7802f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:21.847074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9aca-2fec-4585-a4f0-438f97d8ef6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:21.847761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9aca-2fec-4585-a4f0-438f97d8ef6a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:21.848179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9aca-2fec-4585-a4f0-438f97d8ef6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:21.848869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9aca-2fec-4585-a4f0-438f97d8ef6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:21.849243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb9aca-2fec-4585-a4f0-438f97d8ef6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:21.850738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb9aca-2fec-4585-a4f0-438f97d8ef6a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:21.873399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1241/2457] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:21.873678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bd5b5-1da3-498e-99c3-2a4418148bc0 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:21.884845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28bd5b5-1da3-498e-99c3-2a4418148bc0 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:21.889886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be55a50-20ac-42a1-94de-88dfd4fd3162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:21.895455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be55a50-20ac-42a1-94de-88dfd4fd3162 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:21.895455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be55a50-20ac-42a1-94de-88dfd4fd3162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:21.895455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be55a50-20ac-42a1-94de-88dfd4fd3162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:21.895455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be55a50-20ac-42a1-94de-88dfd4fd3162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:21.895455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be55a50-20ac-42a1-94de-88dfd4fd3162 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:21.906254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1217/2458] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:43:21.910469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9aca-2fec-4585-a4f0-438f97d8ef6a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:21.922104 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9aca-2fec-4585-a4f0-438f97d8ef6a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:21.926847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d933277-89d9-45c1-b112-fe6db7f2449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:21.927727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d933277-89d9-45c1-b112-fe6db7f2449d admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:21.928030 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d933277-89d9-45c1-b112-fe6db7f2449d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:21.928423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d933277-89d9-45c1-b112-fe6db7f2449d admin admin] PATH_INFO: `/v3/projects/52f35cb90b2b4d21af34252fd55ae449/users/ce7c05bfa26d4edbbdcb7ac03b7d1400/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:21.943721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d933277-89d9-45c1-b112-fe6db7f2449d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52f35cb90b2b4d21af34252fd55ae449, user_id=ce7c05bfa26d4edbbdcb7ac03b7d1400, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:21.946454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d933277-89d9-45c1-b112-fe6db7f2449d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:22.034165 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1242/2459] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:21 2022] PUT /identity/v3/projects/52f35cb90b2b4d21af34252fd55ae449/users/ce7c05bfa26d4edbbdcb7ac03b7d1400/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:22.044082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b438c-aded-49b3-98bc-6f52f2bb99e2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:22.045034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b438c-aded-49b3-98bc-6f52f2bb99e2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:22.045320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840b438c-aded-49b3-98bc-6f52f2bb99e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:22.076346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-840b438c-aded-49b3-98bc-6f52f2bb99e2 None None] MFA Rules not processed for user `ce7c05bfa26d4edbbdcb7ac03b7d1400`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:22.077623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-840b438c-aded-49b3-98bc-6f52f2bb99e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:22.149647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1218/2460] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:22.154776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d933277-89d9-45c1-b112-fe6db7f2449d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:22.160639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:22.223490 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d933277-89d9-45c1-b112-fe6db7f2449d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:22.228172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a54b1-3015-411e-889e-226526f61d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:22.229115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a54b1-3015-411e-889e-226526f61d5d admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:22.229396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a54b1-3015-411e-889e-226526f61d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:22.229669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63a54b1-3015-411e-889e-226526f61d5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:22.230589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a54b1-3015-411e-889e-226526f61d5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:22.232939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63a54b1-3015-411e-889e-226526f61d5d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:22.440762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1243/2461] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:22 2022] POST /identity/v3/projects => generated 389 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:22.452386 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b438c-aded-49b3-98bc-6f52f2bb99e2 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:22.467577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840b438c-aded-49b3-98bc-6f52f2bb99e2 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:22.532436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885cf3-ec36-42e2-a2dd-c433fe95e29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:22.533149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885cf3-ec36-42e2-a2dd-c433fe95e29b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:22.533433 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885cf3-ec36-42e2-a2dd-c433fe95e29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:22.533712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885cf3-ec36-42e2-a2dd-c433fe95e29b admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:22.534426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa885cf3-ec36-42e2-a2dd-c433fe95e29b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:22.536697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa885cf3-ec36-42e2-a2dd-c433fe95e29b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:22.675652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1219/2462] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:22 2022] POST /identity/v3/users => generated 301 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:22.679600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a54b1-3015-411e-889e-226526f61d5d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:22.691760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63a54b1-3015-411e-889e-226526f61d5d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:22.696792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78405810-632e-4010-896f-b711a951f12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:22.697476 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405810-632e-4010-896f-b711a951f12c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:22.697759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405810-632e-4010-896f-b711a951f12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:22.698033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78405810-632e-4010-896f-b711a951f12c admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:22.698764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78405810-632e-4010-896f-b711a951f12c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:22.700373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78405810-632e-4010-896f-b711a951f12c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:22.714206 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1244/2463] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:22.719789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885cf3-ec36-42e2-a2dd-c433fe95e29b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:22.734158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885cf3-ec36-42e2-a2dd-c433fe95e29b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:22.742067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293fdd6-f86e-478d-be0a-20e384354c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:22.742879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293fdd6-f86e-478d-be0a-20e384354c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:22.743558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293fdd6-f86e-478d-be0a-20e384354c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:22.743911 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293fdd6-f86e-478d-be0a-20e384354c2f admin admin] PATH_INFO: `/v3/projects/5057e80a34c74fc09cf46846b25e79e2/users/f1dad911d6864096b3b4a5ff48246ece/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:22.771975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293fdd6-f86e-478d-be0a-20e384354c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5057e80a34c74fc09cf46846b25e79e2, user_id=f1dad911d6864096b3b4a5ff48246ece, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:22.775278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293fdd6-f86e-478d-be0a-20e384354c2f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:22.934011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1220/2464] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:22 2022] PUT /identity/v3/projects/5057e80a34c74fc09cf46846b25e79e2/users/f1dad911d6864096b3b4a5ff48246ece/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:22.934450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78405810-632e-4010-896f-b711a951f12c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:22.945404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78405810-632e-4010-896f-b711a951f12c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:23.012860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea82668e-6188-4b56-b423-079ddc4921c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:23.013726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82668e-6188-4b56-b423-079ddc4921c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:23.014306 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82668e-6188-4b56-b423-079ddc4921c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:23.014768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea82668e-6188-4b56-b423-079ddc4921c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:23.015676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82668e-6188-4b56-b423-079ddc4921c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:23.017841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea82668e-6188-4b56-b423-079ddc4921c7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:23.036755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1245/2465] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:22 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:43:23.040737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293fdd6-f86e-478d-be0a-20e384354c2f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:23.055001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293fdd6-f86e-478d-be0a-20e384354c2f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:23.060954 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3cd01-46e5-4abd-86b6-d0f020a45367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:23.062062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3cd01-46e5-4abd-86b6-d0f020a45367 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:23.062263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3cd01-46e5-4abd-86b6-d0f020a45367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:23.062604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3cd01-46e5-4abd-86b6-d0f020a45367 admin admin] PATH_INFO: `/v3/projects/5057e80a34c74fc09cf46846b25e79e2/users/f1dad911d6864096b3b4a5ff48246ece/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:23.064714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3cd01-46e5-4abd-86b6-d0f020a45367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5057e80a34c74fc09cf46846b25e79e2, user_id=f1dad911d6864096b3b4a5ff48246ece, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:23.067588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3cd01-46e5-4abd-86b6-d0f020a45367 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:23.078466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1221/2466] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:23 2022] PUT /identity/v3/projects/5057e80a34c74fc09cf46846b25e79e2/users/f1dad911d6864096b3b4a5ff48246ece/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:23.089987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fb38e-4832-48c6-9600-e714a9974155 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:23.090303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fb38e-4832-48c6-9600-e714a9974155 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:23.090607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66fb38e-4832-48c6-9600-e714a9974155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:23.118599 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b66fb38e-4832-48c6-9600-e714a9974155 None None] MFA Rules not processed for user `f1dad911d6864096b3b4a5ff48246ece`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:23.119805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b66fb38e-4832-48c6-9600-e714a9974155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:23.163622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3cd01-46e5-4abd-86b6-d0f020a45367 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:23.165892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6fc3cd01-46e5-4abd-86b6-d0f020a45367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:23.202236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1246/2467] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:23.212613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fb38e-4832-48c6-9600-e714a9974155 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:23.214246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b66fb38e-4832-48c6-9600-e714a9974155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:23.248273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3cd01-46e5-4abd-86b6-d0f020a45367 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:23.253841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:23.254720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:23.255340 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:23.255824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] PATH_INFO: `/v3/users/28d83ef95cda448dbd72acbd13a5f008` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:23.257432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d83ef95cda448dbd72acbd13a5f008)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:23.259361 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:23.296275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66fb38e-4832-48c6-9600-e714a9974155 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:23.300792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0492fb7-8be0-4e46-ade2-769e744142f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:23.301445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0492fb7-8be0-4e46-ade2-769e744142f6 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:23.301962 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0492fb7-8be0-4e46-ade2-769e744142f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:23.302425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0492fb7-8be0-4e46-ade2-769e744142f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:23.324818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0492fb7-8be0-4e46-ade2-769e744142f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:23.326879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0492fb7-8be0-4e46-ade2-769e744142f6 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:23.340811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1247/2468] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:23.401540 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0492fb7-8be0-4e46-ade2-769e744142f6 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:23.410730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0492fb7-8be0-4e46-ade2-769e744142f6 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:23.415457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011d6c1-6f21-4586-8ebb-cadf600807dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:23.416098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011d6c1-6f21-4586-8ebb-cadf600807dd service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:23.416379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011d6c1-6f21-4586-8ebb-cadf600807dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:23.416689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011d6c1-6f21-4586-8ebb-cadf600807dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:23.473986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011d6c1-6f21-4586-8ebb-cadf600807dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:23.475428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011d6c1-6f21-4586-8ebb-cadf600807dd service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:23.484340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1248/2469] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:23.881948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d83ef95cda448dbd72acbd13a5f008'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:23.890517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d83ef95cda448dbd72acbd13a5f008'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:23.892457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d83ef95cda448dbd72acbd13a5f008'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:23.924375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d83ef95cda448dbd72acbd13a5f008'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:23.925588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ed3f788f-59c8-4f4a-a895-c6449074b674 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d83ef95cda448dbd72acbd13a5f008'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:24.110764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1222/2470] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:23 2022] DELETE /identity/v3/users/28d83ef95cda448dbd72acbd13a5f008 => generated 0 bytes in 948 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:24.157343 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:24.419240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011d6c1-6f21-4586-8ebb-cadf600807dd service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:24.426650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011d6c1-6f21-4586-8ebb-cadf600807dd service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:24.485515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:24.486433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:24.486719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:24.486996 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] PATH_INFO: `/v3/projects/294afe2c36184564a80fb6bef7b32359` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:24.488183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=294afe2c36184564a80fb6bef7b32359)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:24.490406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:24.652290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '294afe2c36184564a80fb6bef7b32359', 'request_id': 'req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:24.658905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '294afe2c36184564a80fb6bef7b32359', 'request_id': 'req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:24.664131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '294afe2c36184564a80fb6bef7b32359', 'request_id': 'req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:24.784378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] The token cache is being invalidate because project 294afe2c36184564a80fb6bef7b32359 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:24.789121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:24.789121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9cb2342d-56d2-4346-aee3-ea4d235ad6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:24.789121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1249/2471] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:24 2022] DELETE /identity/v3/projects/294afe2c36184564a80fb6bef7b32359 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:24.792030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5b1f5-3777-44ce-8c98-69e9406e342d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:24.792314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5b1f5-3777-44ce-8c98-69e9406e342d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:24.792614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5b1f5-3777-44ce-8c98-69e9406e342d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:24.810576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b0f5b1f5-3777-44ce-8c98-69e9406e342d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:24.811774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b0f5b1f5-3777-44ce-8c98-69e9406e342d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:24.869972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1223/2472] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:24.878067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f5a8-dc96-429d-99aa-3f33e7d7f26e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:24.878443 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f5a8-dc96-429d-99aa-3f33e7d7f26e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:24.878729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795f5a8-dc96-429d-99aa-3f33e7d7f26e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:24.898210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-2795f5a8-dc96-429d-99aa-3f33e7d7f26e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:24.899419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2795f5a8-dc96-429d-99aa-3f33e7d7f26e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:24.907900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1250/2473] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:24.912099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5b1f5-3777-44ce-8c98-69e9406e342d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:24.922233 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5b1f5-3777-44ce-8c98-69e9406e342d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:24.927738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:24.928737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:24.929498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:24.929914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:24.930192 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:24.931240 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:24.931360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:24.933155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:24.946568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1224/2474] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:43:24.950660 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f5a8-dc96-429d-99aa-3f33e7d7f26e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:24.961026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795f5a8-dc96-429d-99aa-3f33e7d7f26e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:24.967436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b25264-8766-4e0a-a402-b92e86d19533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:24.967436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b25264-8766-4e0a-a402-b92e86d19533 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:24.967436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b25264-8766-4e0a-a402-b92e86d19533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:24.967436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b25264-8766-4e0a-a402-b92e86d19533 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:24.967910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b25264-8766-4e0a-a402-b92e86d19533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:24.969818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b25264-8766-4e0a-a402-b92e86d19533 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:25.045030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:25.047252 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:25.072336 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1251/2475] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:24 2022] POST /identity/v3/projects => generated 367 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:43:25.076493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b25264-8766-4e0a-a402-b92e86d19533 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:25.104622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22380134-a548-4549-8c00-0f31f20e779e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:25.141358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b25264-8766-4e0a-a402-b92e86d19533 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:25.146613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896347-3cea-4dc9-81cf-f4e4d717d51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:25.147282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896347-3cea-4dc9-81cf-f4e4d717d51a admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:25.147566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896347-3cea-4dc9-81cf-f4e4d717d51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:25.147842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9896347-3cea-4dc9-81cf-f4e4d717d51a admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:25.148880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896347-3cea-4dc9-81cf-f4e4d717d51a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:25.154396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9896347-3cea-4dc9-81cf-f4e4d717d51a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:25.158453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7dabb-d0fb-49bb-b0d9-b190b3ec6600 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:25.160204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7dabb-d0fb-49bb-b0d9-b190b3ec6600 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:25.160204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7dabb-d0fb-49bb-b0d9-b190b3ec6600 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:25.160204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7dabb-d0fb-49bb-b0d9-b190b3ec6600 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:25.161924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4ca7dabb-d0fb-49bb-b0d9-b190b3ec6600 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:25.175366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7dabb-d0fb-49bb-b0d9-b190b3ec6600 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:25.176862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7dabb-d0fb-49bb-b0d9-b190b3ec6600 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:25.187219 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1225/2476] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:25.259034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1252/2477] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:25 2022] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:25.263303 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7dabb-d0fb-49bb-b0d9-b190b3ec6600 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:25.274593 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7dabb-d0fb-49bb-b0d9-b190b3ec6600 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:25.279611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b5bc1-183e-4643-bd7c-059609b13cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:25.280502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5bc1-183e-4643-bd7c-059609b13cea admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:25.280783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5bc1-183e-4643-bd7c-059609b13cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:25.281081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b5bc1-183e-4643-bd7c-059609b13cea admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:25.282030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b5bc1-183e-4643-bd7c-059609b13cea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:25.283687 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b5bc1-183e-4643-bd7c-059609b13cea admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:25.298793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1226/2478] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:25.300250 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896347-3cea-4dc9-81cf-f4e4d717d51a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:25.310908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9896347-3cea-4dc9-81cf-f4e4d717d51a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:25.316514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c46649-c1e7-4eac-b4ae-63810129ba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:25.317207 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c46649-c1e7-4eac-b4ae-63810129ba02 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:25.317492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c46649-c1e7-4eac-b4ae-63810129ba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:25.317769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c46649-c1e7-4eac-b4ae-63810129ba02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:25.318502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c46649-c1e7-4eac-b4ae-63810129ba02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:25.320148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c46649-c1e7-4eac-b4ae-63810129ba02 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:25.331730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1253/2479] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:25.336533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b5bc1-183e-4643-bd7c-059609b13cea admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:25.348273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b5bc1-183e-4643-bd7c-059609b13cea admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:25.353272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1f11c-b31b-44fd-bd5a-fa244b7dbaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:25.354186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1f11c-b31b-44fd-bd5a-fa244b7dbaed admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:25.354466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1f11c-b31b-44fd-bd5a-fa244b7dbaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:25.354743 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e1f11c-b31b-44fd-bd5a-fa244b7dbaed admin admin] PATH_INFO: `/v3/projects/7bd9fa9ef62748d681ec00c372b9b78a/users/49ba096d3a484e6a9ef13a063358fb5f/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:25.371979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1f11c-b31b-44fd-bd5a-fa244b7dbaed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7bd9fa9ef62748d681ec00c372b9b78a, user_id=49ba096d3a484e6a9ef13a063358fb5f, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:25.375298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e1f11c-b31b-44fd-bd5a-fa244b7dbaed admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:25.516898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1227/2480] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:25 2022] PUT /identity/v3/projects/7bd9fa9ef62748d681ec00c372b9b78a/users/49ba096d3a484e6a9ef13a063358fb5f/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:25.528036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db47e7-f6c8-445c-b0f0-36bf57171633 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:25.528624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db47e7-f6c8-445c-b0f0-36bf57171633 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:25.528624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db47e7-f6c8-445c-b0f0-36bf57171633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:25.556782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b2db47e7-f6c8-445c-b0f0-36bf57171633 None None] MFA Rules not processed for user `49ba096d3a484e6a9ef13a063358fb5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:25.558028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b2db47e7-f6c8-445c-b0f0-36bf57171633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:25.634986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1254/2481] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:25 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:25.659130 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1f11c-b31b-44fd-bd5a-fa244b7dbaed admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:25.661126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f6e1f11c-b31b-44fd-bd5a-fa244b7dbaed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:25.727511 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e1f11c-b31b-44fd-bd5a-fa244b7dbaed admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:25.731185 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447ffa7-b10b-407d-9b27-41c941937bef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:25.731835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447ffa7-b10b-407d-9b27-41c941937bef service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:25.732120 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447ffa7-b10b-407d-9b27-41c941937bef service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:25.732394 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447ffa7-b10b-407d-9b27-41c941937bef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:25.741943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447ffa7-b10b-407d-9b27-41c941937bef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:25.743368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447ffa7-b10b-407d-9b27-41c941937bef service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:25.752863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1228/2482] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:25 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:25.994886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:26.105163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:29.030732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db47e7-f6c8-445c-b0f0-36bf57171633 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:29.032243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b2db47e7-f6c8-445c-b0f0-36bf57171633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:29.046013 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:29.104343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db47e7-f6c8-445c-b0f0-36bf57171633 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:29.109771 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ca206-aef6-4d39-9abb-1d294ed08dd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:29.110409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ca206-aef6-4d39-9abb-1d294ed08dd1 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:29.110690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ca206-aef6-4d39-9abb-1d294ed08dd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:29.110965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ca206-aef6-4d39-9abb-1d294ed08dd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:29.112762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-204ca206-aef6-4d39-9abb-1d294ed08dd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:29.124236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ca206-aef6-4d39-9abb-1d294ed08dd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:29.126536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ca206-aef6-4d39-9abb-1d294ed08dd1 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:29.136901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1255/2483] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:29 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:29.186165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447ffa7-b10b-407d-9b27-41c941937bef service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:29.188447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8447ffa7-b10b-407d-9b27-41c941937bef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:29.236079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:29.258112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447ffa7-b10b-407d-9b27-41c941937bef service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:29.263014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:29.268209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:29.268209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:29.268209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] PATH_INFO: `/v3/users/18eb8b615526451498d3adc382d5a410` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:29.268209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18eb8b615526451498d3adc382d5a410)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:29.268209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:29.449167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18eb8b615526451498d3adc382d5a410'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:29.456238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18eb8b615526451498d3adc382d5a410'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:29.456979 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18eb8b615526451498d3adc382d5a410'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:29.469666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18eb8b615526451498d3adc382d5a410'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:29.470372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6d971b9c-1330-499b-b520-5c871a3f5c46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18eb8b615526451498d3adc382d5a410'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:29.544237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1229/2484] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:29 2022] DELETE /identity/v3/users/18eb8b615526451498d3adc382d5a410 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:29.831852 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ca206-aef6-4d39-9abb-1d294ed08dd1 service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:29.843653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ca206-aef6-4d39-9abb-1d294ed08dd1 service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:29.901732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:29.902592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:29.902871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:29.903146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] PATH_INFO: `/v3/projects/c4406d5d0e2347f1b96c34496f5ba5ae` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:29.904324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4406d5d0e2347f1b96c34496f5ba5ae)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:29.906385 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:30.016071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'request_id': 'req-05bfc932-c176-44a4-a061-1fc3c425da18'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:30.023239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'request_id': 'req-05bfc932-c176-44a4-a061-1fc3c425da18'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:30.028878 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'request_id': 'req-05bfc932-c176-44a4-a061-1fc3c425da18'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:30.127316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] The token cache is being invalidate because project c4406d5d0e2347f1b96c34496f5ba5ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:30.127930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:30.128276 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-05bfc932-c176-44a4-a061-1fc3c425da18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:30.129920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1256/2485] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:29 2022] DELETE /identity/v3/projects/c4406d5d0e2347f1b96c34496f5ba5ae => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:30.134855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea91bb-5dc7-4566-807e-0e7d098cb537 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.135144 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea91bb-5dc7-4566-807e-0e7d098cb537 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.135453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea91bb-5dc7-4566-807e-0e7d098cb537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:30.154795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b0ea91bb-5dc7-4566-807e-0e7d098cb537 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:30.155997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b0ea91bb-5dc7-4566-807e-0e7d098cb537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:30.216787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1230/2486] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:30.225257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65e75b-12dd-480a-ae69-1c1cf3b03fca None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.225553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65e75b-12dd-480a-ae69-1c1cf3b03fca None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.225838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65e75b-12dd-480a-ae69-1c1cf3b03fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:30.246519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-4a65e75b-12dd-480a-ae69-1c1cf3b03fca None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:30.247845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4a65e75b-12dd-480a-ae69-1c1cf3b03fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:30.256625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1257/2487] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:30.260967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea91bb-5dc7-4566-807e-0e7d098cb537 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:30.271644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea91bb-5dc7-4566-807e-0e7d098cb537 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:30.276382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd277a7-d710-48fd-9f00-dd5b51b2409a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:30.277063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd277a7-d710-48fd-9f00-dd5b51b2409a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.277341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd277a7-d710-48fd-9f00-dd5b51b2409a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.277612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd277a7-d710-48fd-9f00-dd5b51b2409a admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:30.278365 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd277a7-d710-48fd-9f00-dd5b51b2409a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:30.278669 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd277a7-d710-48fd-9f00-dd5b51b2409a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:30.280268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd277a7-d710-48fd-9f00-dd5b51b2409a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:30.294590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1231/2488] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:43:30.299321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65e75b-12dd-480a-ae69-1c1cf3b03fca None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:30.309278 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65e75b-12dd-480a-ae69-1c1cf3b03fca None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:30.315596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66437e7-2860-440a-955b-b420ce261c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:30.318426 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66437e7-2860-440a-955b-b420ce261c12 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.318721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66437e7-2860-440a-955b-b420ce261c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.319006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66437e7-2860-440a-955b-b420ce261c12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:30.319732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66437e7-2860-440a-955b-b420ce261c12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:30.322267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66437e7-2860-440a-955b-b420ce261c12 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:30.403072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1258/2489] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:30 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:30.407049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd277a7-d710-48fd-9f00-dd5b51b2409a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:30.416900 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd277a7-d710-48fd-9f00-dd5b51b2409a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:30.461439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:30.475142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c2b79-5594-4f84-9644-d8d158127315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:30.475810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c2b79-5594-4f84-9644-d8d158127315 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.476095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c2b79-5594-4f84-9644-d8d158127315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.476378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2c2b79-5594-4f84-9644-d8d158127315 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:30.477141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c2b79-5594-4f84-9644-d8d158127315 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:30.479054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2c2b79-5594-4f84-9644-d8d158127315 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:30.567236 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1232/2490] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:30 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:30.571474 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66437e7-2860-440a-955b-b420ce261c12 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:30.577253 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:30.583401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66437e7-2860-440a-955b-b420ce261c12 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:30.588555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075506c-043a-40b4-9bf4-1a84dea3b840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:30.589324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075506c-043a-40b4-9bf4-1a84dea3b840 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.589597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075506c-043a-40b4-9bf4-1a84dea3b840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.589875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d075506c-043a-40b4-9bf4-1a84dea3b840 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:30.590601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075506c-043a-40b4-9bf4-1a84dea3b840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:30.592221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d075506c-043a-40b4-9bf4-1a84dea3b840 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:30.604304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1259/2491] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:30.612359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c2b79-5594-4f84-9644-d8d158127315 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:30.622676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2c2b79-5594-4f84-9644-d8d158127315 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:30.627765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a80310-c87f-42c3-8d95-47a6cba5175f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:30.628449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a80310-c87f-42c3-8d95-47a6cba5175f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.628762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a80310-c87f-42c3-8d95-47a6cba5175f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.629036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a80310-c87f-42c3-8d95-47a6cba5175f admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:30.635644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a80310-c87f-42c3-8d95-47a6cba5175f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:30.635644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a80310-c87f-42c3-8d95-47a6cba5175f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:30.642729 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1233/2492] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:30.646860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075506c-043a-40b4-9bf4-1a84dea3b840 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:30.657614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d075506c-043a-40b4-9bf4-1a84dea3b840 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:30.662183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78cd35-4816-43f6-b60b-6b9f3748d318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:30.663121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78cd35-4816-43f6-b60b-6b9f3748d318 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.663402 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78cd35-4816-43f6-b60b-6b9f3748d318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.663735 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78cd35-4816-43f6-b60b-6b9f3748d318 admin admin] PATH_INFO: `/v3/projects/286bb5fd6a634b21a7d42a8eed4c61b0/users/98fb77f4c1ca4a7fbc5d9d8c75f9e74b/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:30.678514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78cd35-4816-43f6-b60b-6b9f3748d318 admin admin] RBAC: Authorizing `identity:create_grant(project_id=286bb5fd6a634b21a7d42a8eed4c61b0, user_id=98fb77f4c1ca4a7fbc5d9d8c75f9e74b, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:30.681234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78cd35-4816-43f6-b60b-6b9f3748d318 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:30.784611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1260/2493] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:30 2022] PUT /identity/v3/projects/286bb5fd6a634b21a7d42a8eed4c61b0/users/98fb77f4c1ca4a7fbc5d9d8c75f9e74b/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:30.795755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87c2e-cadc-49a9-8ed1-4c7cc67e77b2 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.796039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87c2e-cadc-49a9-8ed1-4c7cc67e77b2 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.796320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e87c2e-cadc-49a9-8ed1-4c7cc67e77b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:30.822906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c9e87c2e-cadc-49a9-8ed1-4c7cc67e77b2 None None] MFA Rules not processed for user `98fb77f4c1ca4a7fbc5d9d8c75f9e74b`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:30.824155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c9e87c2e-cadc-49a9-8ed1-4c7cc67e77b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:30.893604 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1234/2494] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:30 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:30.913156 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78cd35-4816-43f6-b60b-6b9f3748d318 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:30.914929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5b78cd35-4816-43f6-b60b-6b9f3748d318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:30.990954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78cd35-4816-43f6-b60b-6b9f3748d318 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:30.996540 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5677-21d0-4f82-aa77-d763ec476958 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:30.997185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5677-21d0-4f82-aa77-d763ec476958 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:30.997466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5677-21d0-4f82-aa77-d763ec476958 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:30.997746 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471d5677-21d0-4f82-aa77-d763ec476958 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:31.006285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d5677-21d0-4f82-aa77-d763ec476958 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:31.007855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471d5677-21d0-4f82-aa77-d763ec476958 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:31.018597 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1261/2495] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:30 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:31.230178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667e64f-0292-4824-b443-f80b6648c2cf None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:31.230673 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667e64f-0292-4824-b443-f80b6648c2cf None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:31.230782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667e64f-0292-4824-b443-f80b6648c2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:31.251549 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-0667e64f-0292-4824-b443-f80b6648c2cf None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:31.253304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0667e64f-0292-4824-b443-f80b6648c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:31.309718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1235/2496] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:43:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:31.333911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5677-21d0-4f82-aa77-d763ec476958 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:31.335124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-471d5677-21d0-4f82-aa77-d763ec476958 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:31.418792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471d5677-21d0-4f82-aa77-d763ec476958 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:31.424534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164d9b6-5284-4c01-96a0-abc39dff1c47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:31.425186 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164d9b6-5284-4c01-96a0-abc39dff1c47 service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:31.425469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164d9b6-5284-4c01-96a0-abc39dff1c47 service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:31.425740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164d9b6-5284-4c01-96a0-abc39dff1c47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:31.435065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164d9b6-5284-4c01-96a0-abc39dff1c47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:31.437314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164d9b6-5284-4c01-96a0-abc39dff1c47 service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:31.446175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1262/2497] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:43:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:43:32.536606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667e64f-0292-4824-b443-f80b6648c2cf None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:32.538342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0667e64f-0292-4824-b443-f80b6648c2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:32.603879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667e64f-0292-4824-b443-f80b6648c2cf None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:32.608368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:32.609267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:32.610350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:32.610662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] PATH_INFO: `/v3/users/ce7c05bfa26d4edbbdcb7ac03b7d1400` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:32.611862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7c05bfa26d4edbbdcb7ac03b7d1400)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:32.613819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:32.615540 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:32.862495 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7c05bfa26d4edbbdcb7ac03b7d1400'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:32.870675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7c05bfa26d4edbbdcb7ac03b7d1400'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:32.871358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7c05bfa26d4edbbdcb7ac03b7d1400'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:32.894646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7c05bfa26d4edbbdcb7ac03b7d1400'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:32.895204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7c05bfa26d4edbbdcb7ac03b7d1400'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:33.175180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1236/2498] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:32 2022] DELETE /identity/v3/users/ce7c05bfa26d4edbbdcb7ac03b7d1400 => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:33.180928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4621e6-b68e-45eb-8d2b-01722ded0f43 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:33.181843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4621e6-b68e-45eb-8d2b-01722ded0f43 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:33.182368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4621e6-b68e-45eb-8d2b-01722ded0f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:33.207529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-6c4621e6-b68e-45eb-8d2b-01722ded0f43 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:33.209440 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6c4621e6-b68e-45eb-8d2b-01722ded0f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:33.300032 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:33.353653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1263/2499] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:33.370670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:33.372442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:33.475195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1da8040-8e43-418c-b5e5-2b7a791ac429 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:33.479915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65730494-59da-41c1-b564-91779bee8284 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:33.480904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65730494-59da-41c1-b564-91779bee8284 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:33.481410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65730494-59da-41c1-b564-91779bee8284 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:33.481906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65730494-59da-41c1-b564-91779bee8284 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:33.493579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65730494-59da-41c1-b564-91779bee8284 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:33.495341 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65730494-59da-41c1-b564-91779bee8284 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:33.507608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1237/2500] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:34.123814 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4621e6-b68e-45eb-8d2b-01722ded0f43 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:34.126099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6c4621e6-b68e-45eb-8d2b-01722ded0f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:34.144586 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4621e6-b68e-45eb-8d2b-01722ded0f43 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:34.154985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:34.160614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:34.160614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:34.160614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] PATH_INFO: `/v3/projects/52f35cb90b2b4d21af34252fd55ae449` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:34.160614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52f35cb90b2b4d21af34252fd55ae449)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:34.161961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:34.383219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52f35cb90b2b4d21af34252fd55ae449', 'request_id': 'req-3f943cf8-2d5d-4504-bcf3-e31b48f98029'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.390273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52f35cb90b2b4d21af34252fd55ae449', 'request_id': 'req-3f943cf8-2d5d-4504-bcf3-e31b48f98029'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.400872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52f35cb90b2b4d21af34252fd55ae449', 'request_id': 'req-3f943cf8-2d5d-4504-bcf3-e31b48f98029'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.498613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] The token cache is being invalidate because project 52f35cb90b2b4d21af34252fd55ae449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:34.498967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.501049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.508754 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1264/2501] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:34 2022] DELETE /identity/v3/projects/52f35cb90b2b4d21af34252fd55ae449 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:34.511894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65730494-59da-41c1-b564-91779bee8284 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:34.528527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65730494-59da-41c1-b564-91779bee8284 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:34.550056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:34.550056 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:34.617519 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:34.618530 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:34.618866 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:34.619221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] PATH_INFO: `/v3/users/f1dad911d6864096b3b4a5ff48246ece` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:34.620648 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1dad911d6864096b3b4a5ff48246ece)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:34.622640 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:34.639047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f943cf8-2d5d-4504-bcf3-e31b48f98029 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:34.644375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:34.645425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:34.645933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:34.646318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] PATH_INFO: `/v3/users/98fb77f4c1ca4a7fbc5d9d8c75f9e74b` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:34.647879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=98fb77f4c1ca4a7fbc5d9d8c75f9e74b)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:34.650349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:34.664936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:34.880516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1dad911d6864096b3b4a5ff48246ece'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.889042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1dad911d6864096b3b4a5ff48246ece'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.889800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1dad911d6864096b3b4a5ff48246ece'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.905230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1dad911d6864096b3b4a5ff48246ece'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.913745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6465826-7e0b-46b1-b537-628572c05de6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1dad911d6864096b3b4a5ff48246ece'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.947978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98fb77f4c1ca4a7fbc5d9d8c75f9e74b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.962303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98fb77f4c1ca4a7fbc5d9d8c75f9e74b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:34.993496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:35.263122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1238/2502] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:34 2022] DELETE /identity/v3/users/f1dad911d6864096b3b4a5ff48246ece => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:35.356698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98fb77f4c1ca4a7fbc5d9d8c75f9e74b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:35.356970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98fb77f4c1ca4a7fbc5d9d8c75f9e74b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:35.357596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98fb77f4c1ca4a7fbc5d9d8c75f9e74b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:35.370794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1265/2503] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:34 2022] DELETE /identity/v3/users/98fb77f4c1ca4a7fbc5d9d8c75f9e74b => generated 0 bytes in 826 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:35.375302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac44c5e-1b64-4062-9b6a-07e0bb80a1a3 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:35.376222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac44c5e-1b64-4062-9b6a-07e0bb80a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:35.376714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac44c5e-1b64-4062-9b6a-07e0bb80a1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:35.398208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1ac44c5e-1b64-4062-9b6a-07e0bb80a1a3 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:35.398851 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1ac44c5e-1b64-4062-9b6a-07e0bb80a1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:35.488771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1239/2504] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:35.495435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:35.497148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:35.610055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a391b9-64c7-4e96-8e25-afed7ad811cf admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:35.615423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b5e2c-33d4-45e0-b3a3-7c488a13911c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:35.616209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5e2c-33d4-45e0-b3a3-7c488a13911c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:35.616634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5e2c-33d4-45e0-b3a3-7c488a13911c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:35.617112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b5e2c-33d4-45e0-b3a3-7c488a13911c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:35.629941 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b5e2c-33d4-45e0-b3a3-7c488a13911c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:35.631379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b5e2c-33d4-45e0-b3a3-7c488a13911c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:35.655101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1266/2505] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:35.759794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac44c5e-1b64-4062-9b6a-07e0bb80a1a3 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:35.762102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1ac44c5e-1b64-4062-9b6a-07e0bb80a1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:35.828444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac44c5e-1b64-4062-9b6a-07e0bb80a1a3 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:35.851298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:35.853039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:35.856101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:35.856375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] PATH_INFO: `/v3/projects/5057e80a34c74fc09cf46846b25e79e2` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:35.857999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5057e80a34c74fc09cf46846b25e79e2)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:35.860895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.039674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5057e80a34c74fc09cf46846b25e79e2', 'request_id': 'req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.048743 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5057e80a34c74fc09cf46846b25e79e2', 'request_id': 'req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.057583 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5057e80a34c74fc09cf46846b25e79e2', 'request_id': 'req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.162526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] The token cache is being invalidate because project 5057e80a34c74fc09cf46846b25e79e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:36.163013 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.164819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-337f0116-ef3b-4c65-8aaa-bdb84f3684bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.170212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1240/2506] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:35 2022] DELETE /identity/v3/projects/5057e80a34c74fc09cf46846b25e79e2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:36.175505 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ebe0-5eb4-413e-8d50-7ec485886730 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.176135 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ebe0-5eb4-413e-8d50-7ec485886730 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.176684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45ebe0-5eb4-413e-8d50-7ec485886730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.207016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9c45ebe0-5eb4-413e-8d50-7ec485886730 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:36.208304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9c45ebe0-5eb4-413e-8d50-7ec485886730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:36.294302 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1267/2507] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:36.302649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee1260-d402-44bd-baef-1c4e70cb0336 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.302981 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee1260-d402-44bd-baef-1c4e70cb0336 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.303265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee1260-d402-44bd-baef-1c4e70cb0336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.324400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-06ee1260-d402-44bd-baef-1c4e70cb0336 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:36.326690 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-06ee1260-d402-44bd-baef-1c4e70cb0336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:36.334868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1241/2508] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:36.339341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45ebe0-5eb4-413e-8d50-7ec485886730 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.350330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45ebe0-5eb4-413e-8d50-7ec485886730 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:36.357139 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee1260-d402-44bd-baef-1c4e70cb0336 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.358782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-06ee1260-d402-44bd-baef-1c4e70cb0336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:36.367087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626092e-ee53-473a-b532-48d8879c5129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:36.370147 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626092e-ee53-473a-b532-48d8879c5129 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.370623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626092e-ee53-473a-b532-48d8879c5129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.370891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626092e-ee53-473a-b532-48d8879c5129 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.371765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626092e-ee53-473a-b532-48d8879c5129 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:36.372715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626092e-ee53-473a-b532-48d8879c5129 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:36.380796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626092e-ee53-473a-b532-48d8879c5129 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.387380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee1260-d402-44bd-baef-1c4e70cb0336 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:36.396506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:36.398829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.399204 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.400064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1268/2509] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:43:36.400560 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] PATH_INFO: `/v3/projects/286bb5fd6a634b21a7d42a8eed4c61b0` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.404188 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=286bb5fd6a634b21a7d42a8eed4c61b0)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:36.404349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626092e-ee53-473a-b532-48d8879c5129 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.406382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.415811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626092e-ee53-473a-b532-48d8879c5129 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:36.424784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:36.425924 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ed8b-b421-4608-b31c-3a7413808a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:36.426662 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ed8b-b421-4608-b31c-3a7413808a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.426950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ed8b-b421-4608-b31c-3a7413808a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.427231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ed8b-b421-4608-b31c-3a7413808a31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.428154 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5ed8b-b421-4608-b31c-3a7413808a31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:36.430257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5ed8b-b421-4608-b31c-3a7413808a31 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.524249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286bb5fd6a634b21a7d42a8eed4c61b0', 'request_id': 'req-574ca4b5-3748-41b3-a872-ff84a22aeab3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.532526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286bb5fd6a634b21a7d42a8eed4c61b0', 'request_id': 'req-574ca4b5-3748-41b3-a872-ff84a22aeab3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.540036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286bb5fd6a634b21a7d42a8eed4c61b0', 'request_id': 'req-574ca4b5-3748-41b3-a872-ff84a22aeab3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.545380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1269/2510] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:36 2022] POST /identity/v3/projects => generated 407 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:36.546884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ed8b-b421-4608-b31c-3a7413808a31 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.613704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] The token cache is being invalidate because project 286bb5fd6a634b21a7d42a8eed4c61b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:36.613966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.614824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-574ca4b5-3748-41b3-a872-ff84a22aeab3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:36.619794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1242/2511] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:36 2022] DELETE /identity/v3/projects/286bb5fd6a634b21a7d42a8eed4c61b0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:36.621517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f241-90c2-49c7-b32b-5023a6595294 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.621642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f241-90c2-49c7-b32b-5023a6595294 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.621895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42f241-90c2-49c7-b32b-5023a6595294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.627246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:36.639082 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5ed8b-b421-4608-b31c-3a7413808a31 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:36.645303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139ecda-72df-407f-89b8-76cc6e16c437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:36.646190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ecda-72df-407f-89b8-76cc6e16c437 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.646627 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ecda-72df-407f-89b8-76cc6e16c437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.647002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9139ecda-72df-407f-89b8-76cc6e16c437 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.647806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139ecda-72df-407f-89b8-76cc6e16c437 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:36.651191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9139ecda-72df-407f-89b8-76cc6e16c437 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.668842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6e42f241-90c2-49c7-b32b-5023a6595294 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:36.670087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6e42f241-90c2-49c7-b32b-5023a6595294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:36.680328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1243/2512] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:36.688135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949afc1f-27f7-48f2-9e1f-82716dce02bb None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.689017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949afc1f-27f7-48f2-9e1f-82716dce02bb None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.692681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949afc1f-27f7-48f2-9e1f-82716dce02bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.720569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-949afc1f-27f7-48f2-9e1f-82716dce02bb None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:36.722090 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-949afc1f-27f7-48f2-9e1f-82716dce02bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:36.730477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1270/2513] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:36 2022] POST /identity/v3/users => generated 304 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:36.736407 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1244/2514] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:36.737009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139ecda-72df-407f-89b8-76cc6e16c437 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.737135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949afc1f-27f7-48f2-9e1f-82716dce02bb None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.740871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9139ecda-72df-407f-89b8-76cc6e16c437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:36.747501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949afc1f-27f7-48f2-9e1f-82716dce02bb None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:36.755733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a9e94-d3c1-4f93-9722-0304be5b09a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:36.756460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a9e94-d3c1-4f93-9722-0304be5b09a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.756736 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a9e94-d3c1-4f93-9722-0304be5b09a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.757189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596a9e94-d3c1-4f93-9722-0304be5b09a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.757326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9139ecda-72df-407f-89b8-76cc6e16c437 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:36.757799 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a9e94-d3c1-4f93-9722-0304be5b09a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:36.758190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a9e94-d3c1-4f93-9722-0304be5b09a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:36.759770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596a9e94-d3c1-4f93-9722-0304be5b09a7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.764178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fd900-ed2f-4add-9529-1683090369b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:36.764929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fd900-ed2f-4add-9529-1683090369b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.765307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fd900-ed2f-4add-9529-1683090369b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.765765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8fd900-ed2f-4add-9529-1683090369b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.768077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fd900-ed2f-4add-9529-1683090369b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:36.769608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8fd900-ed2f-4add-9529-1683090369b9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.776734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1245/2515] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:43:36.789260 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1271/2516] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:36.789562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a9e94-d3c1-4f93-9722-0304be5b09a7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.790318 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fd900-ed2f-4add-9529-1683090369b9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.801502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8fd900-ed2f-4add-9529-1683090369b9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:36.801719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596a9e94-d3c1-4f93-9722-0304be5b09a7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:36.806974 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517dc5a-fc23-44ce-bd28-10d3d74ae3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:36.808058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517dc5a-fc23-44ce-bd28-10d3d74ae3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.808058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517dc5a-fc23-44ce-bd28-10d3d74ae3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.808351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c694f93-673d-43e8-86ee-b2bc12d8a0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:36.808585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1517dc5a-fc23-44ce-bd28-10d3d74ae3b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.809024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694f93-673d-43e8-86ee-b2bc12d8a0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.809148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517dc5a-fc23-44ce-bd28-10d3d74ae3b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:36.809802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694f93-673d-43e8-86ee-b2bc12d8a0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.810329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c694f93-673d-43e8-86ee-b2bc12d8a0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.810991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c694f93-673d-43e8-86ee-b2bc12d8a0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:36.811437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1517dc5a-fc23-44ce-bd28-10d3d74ae3b8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.812850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c694f93-673d-43e8-86ee-b2bc12d8a0a3 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.829591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1272/2517] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:36.838705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c694f93-673d-43e8-86ee-b2bc12d8a0a3 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.849901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c694f93-673d-43e8-86ee-b2bc12d8a0a3 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:36.856582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d90835-db89-4fbb-a6a8-8e8c1575e090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:36.857701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d90835-db89-4fbb-a6a8-8e8c1575e090 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.857985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d90835-db89-4fbb-a6a8-8e8c1575e090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.858263 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d90835-db89-4fbb-a6a8-8e8c1575e090 admin admin] PATH_INFO: `/v3/projects/602e77650b9343318abf1af3b5c556af/users/065e7e6ec7e5491597565e64324c5686/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:36.877219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d90835-db89-4fbb-a6a8-8e8c1575e090 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602e77650b9343318abf1af3b5c556af, user_id=065e7e6ec7e5491597565e64324c5686, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:36.883118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d90835-db89-4fbb-a6a8-8e8c1575e090 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:36.956167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1246/2518] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:36 2022] POST /identity/v3/projects => generated 363 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:36.957456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517dc5a-fc23-44ce-bd28-10d3d74ae3b8 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:36.971112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1273/2519] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:36 2022] PUT /identity/v3/projects/602e77650b9343318abf1af3b5c556af/users/065e7e6ec7e5491597565e64324c5686/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:36.988704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b655f-5e3e-4811-bd8a-4729b031cdcd None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:36.989423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b655f-5e3e-4811-bd8a-4729b031cdcd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:36.989860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b655f-5e3e-4811-bd8a-4729b031cdcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.044010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-cb7b655f-5e3e-4811-bd8a-4729b031cdcd None None] MFA Rules not processed for user `065e7e6ec7e5491597565e64324c5686`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:37.047016 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-cb7b655f-5e3e-4811-bd8a-4729b031cdcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:37.081732 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1517dc5a-fc23-44ce-bd28-10d3d74ae3b8 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.153973 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066773bc-c02a-4798-a8b9-d02061f1a46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.154694 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066773bc-c02a-4798-a8b9-d02061f1a46c admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.154975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066773bc-c02a-4798-a8b9-d02061f1a46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.155255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066773bc-c02a-4798-a8b9-d02061f1a46c admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.155956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066773bc-c02a-4798-a8b9-d02061f1a46c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.159612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066773bc-c02a-4798-a8b9-d02061f1a46c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.159889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1274/2520] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:36 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:37.161037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b655f-5e3e-4811-bd8a-4729b031cdcd None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.166592 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:37.175930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b655f-5e3e-4811-bd8a-4729b031cdcd None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.181473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071d08-e054-42ac-8ba1-3c9cb4bf8f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.182146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071d08-e054-42ac-8ba1-3c9cb4bf8f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.182433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071d08-e054-42ac-8ba1-3c9cb4bf8f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.182765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d071d08-e054-42ac-8ba1-3c9cb4bf8f00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.183515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d071d08-e054-42ac-8ba1-3c9cb4bf8f00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.185492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d071d08-e054-42ac-8ba1-3c9cb4bf8f00 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.277012 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1247/2521] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:36 2022] POST /identity/v3/users => generated 282 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:37.281331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066773bc-c02a-4798-a8b9-d02061f1a46c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.288315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1275/2522] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:37 2022] POST /identity/v3/projects => generated 409 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:37.289823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071d08-e054-42ac-8ba1-3c9cb4bf8f00 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.301020 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066773bc-c02a-4798-a8b9-d02061f1a46c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.378175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d071d08-e054-42ac-8ba1-3c9cb4bf8f00 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.389402 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2f294-b598-4603-b4b0-2a33d590f84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.391809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2f294-b598-4603-b4b0-2a33d590f84c admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.391809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2f294-b598-4603-b4b0-2a33d590f84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.391809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2f294-b598-4603-b4b0-2a33d590f84c admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.393301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2f294-b598-4603-b4b0-2a33d590f84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.394637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e2b8a-9419-4404-9426-6187984dc585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.395275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2f294-b598-4603-b4b0-2a33d590f84c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.395529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e2b8a-9419-4404-9426-6187984dc585 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.396103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e2b8a-9419-4404-9426-6187984dc585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.396524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e2b8a-9419-4404-9426-6187984dc585 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.398471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e2b8a-9419-4404-9426-6187984dc585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.400662 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e2b8a-9419-4404-9426-6187984dc585 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.406389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:37.414459 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1248/2523] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:37.419696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e2b8a-9419-4404-9426-6187984dc585 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.430855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e2b8a-9419-4404-9426-6187984dc585 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.440270 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e850e-f2ae-4f42-9de0-216326b128d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.440977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e850e-f2ae-4f42-9de0-216326b128d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.441310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e850e-f2ae-4f42-9de0-216326b128d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.441548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e850e-f2ae-4f42-9de0-216326b128d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.442263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e850e-f2ae-4f42-9de0-216326b128d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.443904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e850e-f2ae-4f42-9de0-216326b128d1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.456770 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1249/2524] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:37.460990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e850e-f2ae-4f42-9de0-216326b128d1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.472764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e850e-f2ae-4f42-9de0-216326b128d1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.477917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452659d-ed84-4627-86df-248494bf13c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.479049 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452659d-ed84-4627-86df-248494bf13c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.479327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452659d-ed84-4627-86df-248494bf13c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.479793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452659d-ed84-4627-86df-248494bf13c7 admin admin] PATH_INFO: `/v3/projects/8f320f57b37940f3bf6008d8de238cab/users/a2edef9a15cc417c9c43c74fc7d00b72/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.506132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452659d-ed84-4627-86df-248494bf13c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f320f57b37940f3bf6008d8de238cab, user_id=a2edef9a15cc417c9c43c74fc7d00b72, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.512737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452659d-ed84-4627-86df-248494bf13c7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.531048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1276/2525] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:37 2022] POST /identity/v3/users => generated 311 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:37.535514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2f294-b598-4603-b4b0-2a33d590f84c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.559829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2f294-b598-4603-b4b0-2a33d590f84c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.565702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1acdb1-9813-4e22-ad88-92df22b54c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.566435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1acdb1-9813-4e22-ad88-92df22b54c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.566722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1acdb1-9813-4e22-ad88-92df22b54c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.566994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1acdb1-9813-4e22-ad88-92df22b54c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.567725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1acdb1-9813-4e22-ad88-92df22b54c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.569356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1acdb1-9813-4e22-ad88-92df22b54c22 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.604531 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1277/2526] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:37.604531 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1acdb1-9813-4e22-ad88-92df22b54c22 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.613609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1250/2527] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:37 2022] PUT /identity/v3/projects/8f320f57b37940f3bf6008d8de238cab/users/a2edef9a15cc417c9c43c74fc7d00b72/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:37.616751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1acdb1-9813-4e22-ad88-92df22b54c22 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.626301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6262b0-5b64-4d48-afab-58f2a3603e9d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.626634 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6262b0-5b64-4d48-afab-58f2a3603e9d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.626901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6262b0-5b64-4d48-afab-58f2a3603e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.661040 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3b6262b0-5b64-4d48-afab-58f2a3603e9d None None] MFA Rules not processed for user `a2edef9a15cc417c9c43c74fc7d00b72`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:37.662234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3b6262b0-5b64-4d48-afab-58f2a3603e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:37.695269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b12cd-a819-4d83-a0d5-2afb3e8bda64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.696707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b12cd-a819-4d83-a0d5-2afb3e8bda64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.697230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b12cd-a819-4d83-a0d5-2afb3e8bda64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.697607 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b12cd-a819-4d83-a0d5-2afb3e8bda64 admin admin] PATH_INFO: `/v3/projects/87daa868ba65422499eabc6c67414837/users/2220ad601daf4c3e8ecee2700471703a/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.721395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b12cd-a819-4d83-a0d5-2afb3e8bda64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87daa868ba65422499eabc6c67414837, user_id=2220ad601daf4c3e8ecee2700471703a, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.724583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b12cd-a819-4d83-a0d5-2afb3e8bda64 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.758670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1251/2528] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:37 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:37.760952 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6262b0-5b64-4d48-afab-58f2a3603e9d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.774431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6262b0-5b64-4d48-afab-58f2a3603e9d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.784914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4af54-31e5-4b37-a631-6feb3acb0af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.786148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4af54-31e5-4b37-a631-6feb3acb0af5 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.786334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4af54-31e5-4b37-a631-6feb3acb0af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.786773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e4af54-31e5-4b37-a631-6feb3acb0af5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.787722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4af54-31e5-4b37-a631-6feb3acb0af5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.790381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e4af54-31e5-4b37-a631-6feb3acb0af5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.839596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1278/2529] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:37 2022] PUT /identity/v3/projects/87daa868ba65422499eabc6c67414837/users/2220ad601daf4c3e8ecee2700471703a/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:37.844448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b12cd-a819-4d83-a0d5-2afb3e8bda64 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.924865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b12cd-a819-4d83-a0d5-2afb3e8bda64 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.930231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4e9ec-e09a-41d1-81a5-a9d1afad86b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:37.930986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4e9ec-e09a-41d1-81a5-a9d1afad86b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:37.931364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4e9ec-e09a-41d1-81a5-a9d1afad86b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:37.931682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4e9ec-e09a-41d1-81a5-a9d1afad86b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:37.932519 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4e9ec-e09a-41d1-81a5-a9d1afad86b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:37.934373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4e9ec-e09a-41d1-81a5-a9d1afad86b7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:37.952183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1279/2530] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:37 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:37.952715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4e9ec-e09a-41d1-81a5-a9d1afad86b7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.953546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1252/2531] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:37 2022] POST /identity/v3/projects => generated 361 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:37.954696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4af54-31e5-4b37-a631-6feb3acb0af5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:37.966811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4e9ec-e09a-41d1-81a5-a9d1afad86b7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:37.991959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:38.053104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e4af54-31e5-4b37-a631-6feb3acb0af5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:38.054042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f374ec-3493-4546-83c6-519dd51dc163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:38.055389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f374ec-3493-4546-83c6-519dd51dc163 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.055917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f374ec-3493-4546-83c6-519dd51dc163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.056425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f374ec-3493-4546-83c6-519dd51dc163 admin admin] PATH_INFO: `/v3/projects/87daa868ba65422499eabc6c67414837/users/2220ad601daf4c3e8ecee2700471703a/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.061304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97824fbc-6431-47ee-b6d8-9379c240092b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:38.061437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f374ec-3493-4546-83c6-519dd51dc163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87daa868ba65422499eabc6c67414837, user_id=2220ad601daf4c3e8ecee2700471703a, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:38.061546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824fbc-6431-47ee-b6d8-9379c240092b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.061546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824fbc-6431-47ee-b6d8-9379c240092b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.061546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97824fbc-6431-47ee-b6d8-9379c240092b admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.061546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97824fbc-6431-47ee-b6d8-9379c240092b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:38.062938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f374ec-3493-4546-83c6-519dd51dc163 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:38.065808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97824fbc-6431-47ee-b6d8-9379c240092b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:38.069163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:38.079411 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1280/2532] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:37 2022] PUT /identity/v3/projects/87daa868ba65422499eabc6c67414837/users/2220ad601daf4c3e8ecee2700471703a/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:38.090999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785409-3a71-411b-8cef-45090a7bfcb2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.091574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785409-3a71-411b-8cef-45090a7bfcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.091574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5785409-3a71-411b-8cef-45090a7bfcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.124197 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-a5785409-3a71-411b-8cef-45090a7bfcb2 None None] MFA Rules not processed for user `2220ad601daf4c3e8ecee2700471703a`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:38.125494 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a5785409-3a71-411b-8cef-45090a7bfcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:38.215211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1253/2533] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:37 2022] POST /identity/v3/users => generated 287 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:38.222042 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97824fbc-6431-47ee-b6d8-9379c240092b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:38.233416 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1281/2534] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:38 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:38.239832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97824fbc-6431-47ee-b6d8-9379c240092b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:38.248604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785409-3a71-411b-8cef-45090a7bfcb2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:38.250107 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a5785409-3a71-411b-8cef-45090a7bfcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:38.315270 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5785409-3a71-411b-8cef-45090a7bfcb2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:38.319352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1badac-8d85-4db5-85cf-adbffdb80257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:38.320001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1badac-8d85-4db5-85cf-adbffdb80257 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.320294 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1badac-8d85-4db5-85cf-adbffdb80257 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.320701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1badac-8d85-4db5-85cf-adbffdb80257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.321865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac965b8-6b6a-4149-acf3-183de05cade8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:38.322738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac965b8-6b6a-4149-acf3-183de05cade8 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.323160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac965b8-6b6a-4149-acf3-183de05cade8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.323740 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac965b8-6b6a-4149-acf3-183de05cade8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.324573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac965b8-6b6a-4149-acf3-183de05cade8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:38.330676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac965b8-6b6a-4149-acf3-183de05cade8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:38.335236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1badac-8d85-4db5-85cf-adbffdb80257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:38.336786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1badac-8d85-4db5-85cf-adbffdb80257 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:38.356521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1254/2535] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:43:38.366955 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac965b8-6b6a-4149-acf3-183de05cade8 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:38.367126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1282/2536] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:38 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:38.375274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac965b8-6b6a-4149-acf3-183de05cade8 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:38.380619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ceff-b772-47d2-9659-95e1a7f76a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:38.381718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ceff-b772-47d2-9659-95e1a7f76a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.382230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ceff-b772-47d2-9659-95e1a7f76a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.382442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03ceff-b772-47d2-9659-95e1a7f76a0f admin admin] PATH_INFO: `/v3/projects/a3d6bb9ed783417a80da8eee479aae7f/users/b23effa26c954f9fb13d47f405d4b9db/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.406462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03ceff-b772-47d2-9659-95e1a7f76a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d6bb9ed783417a80da8eee479aae7f, user_id=b23effa26c954f9fb13d47f405d4b9db, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:38.410127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b03ceff-b772-47d2-9659-95e1a7f76a0f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:38.634112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1badac-8d85-4db5-85cf-adbffdb80257 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:38.635725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ea1badac-8d85-4db5-85cf-adbffdb80257 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:38.654762 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1badac-8d85-4db5-85cf-adbffdb80257 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:38.660894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:38.661751 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.662028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.662296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] PATH_INFO: `/v3/users/49ba096d3a484e6a9ef13a063358fb5f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.663491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49ba096d3a484e6a9ef13a063358fb5f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:38.666579 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:38.794560 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1255/2537] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:38 2022] PUT /identity/v3/projects/a3d6bb9ed783417a80da8eee479aae7f/users/b23effa26c954f9fb13d47f405d4b9db/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:38.797602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ceff-b772-47d2-9659-95e1a7f76a0f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:38.860675 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b03ceff-b772-47d2-9659-95e1a7f76a0f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:38.865668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bae9c-3c2a-4a4f-a109-4821b92aa01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:38.866338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bae9c-3c2a-4a4f-a109-4821b92aa01d admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.866625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bae9c-3c2a-4a4f-a109-4821b92aa01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.866907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bae9c-3c2a-4a4f-a109-4821b92aa01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.867681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bae9c-3c2a-4a4f-a109-4821b92aa01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:38.869326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bae9c-3c2a-4a4f-a109-4821b92aa01d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:38.879671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1256/2538] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:38 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:43:38.883555 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bae9c-3c2a-4a4f-a109-4821b92aa01d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:38.893893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bae9c-3c2a-4a4f-a109-4821b92aa01d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:38.898586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b2162-e945-42ee-89c1-a34dd68da5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:38.899449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2162-e945-42ee-89c1-a34dd68da5c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.901586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2162-e945-42ee-89c1-a34dd68da5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.901586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b2162-e945-42ee-89c1-a34dd68da5c4 admin admin] PATH_INFO: `/v3/projects/a3d6bb9ed783417a80da8eee479aae7f/users/b23effa26c954f9fb13d47f405d4b9db/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.902067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b2162-e945-42ee-89c1-a34dd68da5c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3d6bb9ed783417a80da8eee479aae7f, user_id=b23effa26c954f9fb13d47f405d4b9db, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:38.904666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b2162-e945-42ee-89c1-a34dd68da5c4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:38.916093 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1257/2539] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:38 2022] PUT /identity/v3/projects/a3d6bb9ed783417a80da8eee479aae7f/users/b23effa26c954f9fb13d47f405d4b9db/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:38.929442 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee933d-b003-4dad-8ea8-778cb730da34 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:38.930380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee933d-b003-4dad-8ea8-778cb730da34 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:38.930380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffee933d-b003-4dad-8ea8-778cb730da34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:38.935917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:38.957599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ffee933d-b003-4dad-8ea8-778cb730da34 None None] MFA Rules not processed for user `b23effa26c954f9fb13d47f405d4b9db`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:38.958805 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ffee933d-b003-4dad-8ea8-778cb730da34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:39.043795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1258/2540] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:38 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:39.056444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee933d-b003-4dad-8ea8-778cb730da34 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:39.077012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49ba096d3a484e6a9ef13a063358fb5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:39.096821 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49ba096d3a484e6a9ef13a063358fb5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:39.132149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffee933d-b003-4dad-8ea8-778cb730da34 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:39.136395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247da80-773e-43ed-9888-1060bd17ef7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:39.137197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247da80-773e-43ed-9888-1060bd17ef7e service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:39.137485 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247da80-773e-43ed-9888-1060bd17ef7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:39.137764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247da80-773e-43ed-9888-1060bd17ef7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:39.151759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247da80-773e-43ed-9888-1060bd17ef7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:39.151759 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247da80-773e-43ed-9888-1060bd17ef7e service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:39.168605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1259/2541] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:39 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:39.169710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247da80-773e-43ed-9888-1060bd17ef7e service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:39.171037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7247da80-773e-43ed-9888-1060bd17ef7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:39.185062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247da80-773e-43ed-9888-1060bd17ef7e service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:39.189707 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ac709-a195-41df-b5e0-3326b0391b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:39.190359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ac709-a195-41df-b5e0-3326b0391b83 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:39.190639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ac709-a195-41df-b5e0-3326b0391b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:39.190914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286ac709-a195-41df-b5e0-3326b0391b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:39.213341 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49ba096d3a484e6a9ef13a063358fb5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:39.214028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49ba096d3a484e6a9ef13a063358fb5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:39.214959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b9bef182-2164-4bc6-af8b-bc818254fb08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49ba096d3a484e6a9ef13a063358fb5f'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:39.223053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:39.236807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1283/2542] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:38 2022] DELETE /identity/v3/users/49ba096d3a484e6a9ef13a063358fb5f => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:39.238677 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bf81c-1c63-4113-b7ff-e6de9544c7e1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:39.239460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bf81c-1c63-4113-b7ff-e6de9544c7e1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:39.239871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3bf81c-1c63-4113-b7ff-e6de9544c7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:39.261018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1e3bf81c-1c63-4113-b7ff-e6de9544c7e1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:39.262409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1e3bf81c-1c63-4113-b7ff-e6de9544c7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:39.262674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ac709-a195-41df-b5e0-3326b0391b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:39.272821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286ac709-a195-41df-b5e0-3326b0391b83 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:39.301228 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1260/2543] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:39.353755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1284/2544] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:39.365007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ac709-a195-41df-b5e0-3326b0391b83 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:39.367066 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-286ac709-a195-41df-b5e0-3326b0391b83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:39.440850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bf81c-1c63-4113-b7ff-e6de9544c7e1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:39.442098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1e3bf81c-1c63-4113-b7ff-e6de9544c7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:39.460382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286ac709-a195-41df-b5e0-3326b0391b83 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:39.521391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9c333-ad35-4b50-95da-d800c486502f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:39.522182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9c333-ad35-4b50-95da-d800c486502f service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:39.522485 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9c333-ad35-4b50-95da-d800c486502f service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:39.522871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf9c333-ad35-4b50-95da-d800c486502f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:39.534892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9c333-ad35-4b50-95da-d800c486502f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:39.536709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf9c333-ad35-4b50-95da-d800c486502f service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:39.536910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3bf81c-1c63-4113-b7ff-e6de9544c7e1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:39.541727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f718d5-2d07-436c-8697-c9c090ef327d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:39.543642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f718d5-2d07-436c-8697-c9c090ef327d service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:39.544682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f718d5-2d07-436c-8697-c9c090ef327d service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:39.546094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f718d5-2d07-436c-8697-c9c090ef327d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:39.549437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-86f718d5-2d07-436c-8697-c9c090ef327d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:39.549587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1261/2545] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:39.598942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:39.646604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f718d5-2d07-436c-8697-c9c090ef327d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:39.648455 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f718d5-2d07-436c-8697-c9c090ef327d service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:39.677473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1285/2546] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:40.164247 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9c333-ad35-4b50-95da-d800c486502f service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:40.171264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ecf9c333-ad35-4b50-95da-d800c486502f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:40.207085 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf9c333-ad35-4b50-95da-d800c486502f service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:40.236574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:40.241000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:40.241154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:40.241322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] PATH_INFO: `/v3/projects/7bd9fa9ef62748d681ec00c372b9b78a` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:40.244342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7bd9fa9ef62748d681ec00c372b9b78a)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:40.246410 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:40.406081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7bd9fa9ef62748d681ec00c372b9b78a', 'request_id': 'req-c37b2bb8-d889-4340-a14d-5dffcd619e94'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:40.418652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7bd9fa9ef62748d681ec00c372b9b78a', 'request_id': 'req-c37b2bb8-d889-4340-a14d-5dffcd619e94'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:40.427004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7bd9fa9ef62748d681ec00c372b9b78a', 'request_id': 'req-c37b2bb8-d889-4340-a14d-5dffcd619e94'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:40.561856 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] The token cache is being invalidate because project 7bd9fa9ef62748d681ec00c372b9b78a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:40.562453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:40.564163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c37b2bb8-d889-4340-a14d-5dffcd619e94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:40.566704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1262/2547] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:40 2022] DELETE /identity/v3/projects/7bd9fa9ef62748d681ec00c372b9b78a => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:40.571319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728b870-5cd3-4563-9e07-fb57dfa2895c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:40.571860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728b870-5cd3-4563-9e07-fb57dfa2895c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:40.572322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728b870-5cd3-4563-9e07-fb57dfa2895c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:40.595042 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c728b870-5cd3-4563-9e07-fb57dfa2895c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:40.598535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c728b870-5cd3-4563-9e07-fb57dfa2895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:40.651201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:40.667441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1286/2548] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:40.675713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b6712-8984-4198-9bb5-1e9b5ed4705f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:40.675997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b6712-8984-4198-9bb5-1e9b5ed4705f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:40.676273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b6712-8984-4198-9bb5-1e9b5ed4705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:40.694367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-072b6712-8984-4198-9bb5-1e9b5ed4705f None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:40.695577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-072b6712-8984-4198-9bb5-1e9b5ed4705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:40.703933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1263/2549] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:40.708286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728b870-5cd3-4563-9e07-fb57dfa2895c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:40.718716 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728b870-5cd3-4563-9e07-fb57dfa2895c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:40.723918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e0828-f05f-4ba1-bddc-3ff6eb3a311d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:40.728399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e0828-f05f-4ba1-bddc-3ff6eb3a311d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:40.728399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e0828-f05f-4ba1-bddc-3ff6eb3a311d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:40.728399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e0828-f05f-4ba1-bddc-3ff6eb3a311d admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:40.728399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e0828-f05f-4ba1-bddc-3ff6eb3a311d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:40.728399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e0828-f05f-4ba1-bddc-3ff6eb3a311d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:40.728399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e0828-f05f-4ba1-bddc-3ff6eb3a311d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:40.741164 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1287/2550] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:43:40.745431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b6712-8984-4198-9bb5-1e9b5ed4705f None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:40.754858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b6712-8984-4198-9bb5-1e9b5ed4705f None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:40.760342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607be2d-d6e1-4443-85c7-2d08ea329dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:40.764387 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607be2d-d6e1-4443-85c7-2d08ea329dc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:40.764387 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607be2d-d6e1-4443-85c7-2d08ea329dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:40.764387 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a607be2d-d6e1-4443-85c7-2d08ea329dc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:40.764387 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607be2d-d6e1-4443-85c7-2d08ea329dc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:40.765389 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a607be2d-d6e1-4443-85c7-2d08ea329dc7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:40.929149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1264/2551] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:40 2022] POST /identity/v3/projects => generated 371 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:43:40.931964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e0828-f05f-4ba1-bddc-3ff6eb3a311d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:40.944126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e0828-f05f-4ba1-bddc-3ff6eb3a311d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:41.011822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ff12-954a-4872-b43e-bc856724d363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:41.012512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ff12-954a-4872-b43e-bc856724d363 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:41.012808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ff12-954a-4872-b43e-bc856724d363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:41.013282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e8ff12-954a-4872-b43e-bc856724d363 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:41.013769 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8ff12-954a-4872-b43e-bc856724d363 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:41.015692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e8ff12-954a-4872-b43e-bc856724d363 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:41.146518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1288/2552] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:40 2022] POST /identity/v3/users => generated 286 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:41.150337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607be2d-d6e1-4443-85c7-2d08ea329dc7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:41.162652 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a607be2d-d6e1-4443-85c7-2d08ea329dc7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:41.167375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e868bd-4b9f-4a97-8f51-a079b51dc341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:41.168193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e868bd-4b9f-4a97-8f51-a079b51dc341 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:41.168492 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e868bd-4b9f-4a97-8f51-a079b51dc341 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:41.168767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e868bd-4b9f-4a97-8f51-a079b51dc341 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:41.170658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e868bd-4b9f-4a97-8f51-a079b51dc341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:41.171167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e868bd-4b9f-4a97-8f51-a079b51dc341 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:41.185937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1265/2553] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:43:41.187038 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ff12-954a-4872-b43e-bc856724d363 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:41.198074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e8ff12-954a-4872-b43e-bc856724d363 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:41.204399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96499bb-a7e7-4788-8241-ed7c78e28105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:41.205110 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96499bb-a7e7-4788-8241-ed7c78e28105 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:41.205407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96499bb-a7e7-4788-8241-ed7c78e28105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:41.205742 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96499bb-a7e7-4788-8241-ed7c78e28105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:41.206547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96499bb-a7e7-4788-8241-ed7c78e28105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:41.208285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96499bb-a7e7-4788-8241-ed7c78e28105 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:41.220654 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1289/2554] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:41.224829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e868bd-4b9f-4a97-8f51-a079b51dc341 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:41.237917 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e868bd-4b9f-4a97-8f51-a079b51dc341 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:41.243213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c726e5c-d646-42ec-815d-51d536d8ff4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:41.244318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c726e5c-d646-42ec-815d-51d536d8ff4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:41.244645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c726e5c-d646-42ec-815d-51d536d8ff4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:41.245222 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c726e5c-d646-42ec-815d-51d536d8ff4e admin admin] PATH_INFO: `/v3/projects/7862e790a832494cb029313f6eb00412/users/3ecb1b1557474a7a9647760b23c51358/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:41.262820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c726e5c-d646-42ec-815d-51d536d8ff4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7862e790a832494cb029313f6eb00412, user_id=3ecb1b1557474a7a9647760b23c51358, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:41.265680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c726e5c-d646-42ec-815d-51d536d8ff4e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:41.389068 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1266/2555] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:41 2022] PUT /identity/v3/projects/7862e790a832494cb029313f6eb00412/users/3ecb1b1557474a7a9647760b23c51358/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:41.395295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5669-6355-4b4b-ae08-cca7e566fc15 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:41.395588 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5669-6355-4b4b-ae08-cca7e566fc15 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:41.395867 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5669-6355-4b4b-ae08-cca7e566fc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:41.433018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-dd6e5669-6355-4b4b-ae08-cca7e566fc15 None None] MFA Rules not processed for user `3ecb1b1557474a7a9647760b23c51358`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:41.435155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dd6e5669-6355-4b4b-ae08-cca7e566fc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:41.528972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1290/2556] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:41.530824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c726e5c-d646-42ec-815d-51d536d8ff4e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:41.542458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:41.632034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c726e5c-d646-42ec-815d-51d536d8ff4e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:41.638122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40593052-ce40-46a3-bedd-1226bd17cef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:41.638790 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40593052-ce40-46a3-bedd-1226bd17cef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:41.639104 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40593052-ce40-46a3-bedd-1226bd17cef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:41.639855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40593052-ce40-46a3-bedd-1226bd17cef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:41.640591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40593052-ce40-46a3-bedd-1226bd17cef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:41.642703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40593052-ce40-46a3-bedd-1226bd17cef5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:41.760714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1267/2557] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:41 2022] POST /identity/v3/projects => generated 371 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:43:41.764106 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5669-6355-4b4b-ae08-cca7e566fc15 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:41.783487 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5669-6355-4b4b-ae08-cca7e566fc15 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:41.841213 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:41.855833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895dc22-3a59-44a9-ae5d-47623bca907f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:41.856590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895dc22-3a59-44a9-ae5d-47623bca907f admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:41.856880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895dc22-3a59-44a9-ae5d-47623bca907f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:41.857163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895dc22-3a59-44a9-ae5d-47623bca907f admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:41.857872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895dc22-3a59-44a9-ae5d-47623bca907f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:41.859853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895dc22-3a59-44a9-ae5d-47623bca907f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:41.980522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1291/2558] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:41 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:41.988771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40593052-ce40-46a3-bedd-1226bd17cef5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:42.008156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40593052-ce40-46a3-bedd-1226bd17cef5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:42.014449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5982b-b8d1-4a64-bde3-b177bc36f196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:42.015061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5982b-b8d1-4a64-bde3-b177bc36f196 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:42.015340 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5982b-b8d1-4a64-bde3-b177bc36f196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:42.015606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5982b-b8d1-4a64-bde3-b177bc36f196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:42.017099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5982b-b8d1-4a64-bde3-b177bc36f196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:42.018950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5982b-b8d1-4a64-bde3-b177bc36f196 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:42.036254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1268/2559] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:42.044327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895dc22-3a59-44a9-ae5d-47623bca907f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:42.066401 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895dc22-3a59-44a9-ae5d-47623bca907f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:42.072721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb77fd-20f6-4ebd-a854-0745615cd457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:42.074795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb77fd-20f6-4ebd-a854-0745615cd457 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:42.074795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb77fd-20f6-4ebd-a854-0745615cd457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:42.075007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb77fd-20f6-4ebd-a854-0745615cd457 admin admin] PATH_INFO: `/v3/projects/3bb5c3c0743245adb7624b1b2608261d/users/402b104261144879a9461521f068a8ff/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:42.095765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb77fd-20f6-4ebd-a854-0745615cd457 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb5c3c0743245adb7624b1b2608261d, user_id=402b104261144879a9461521f068a8ff, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:42.098725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb77fd-20f6-4ebd-a854-0745615cd457 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:42.289880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1292/2560] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:42 2022] PUT /identity/v3/projects/3bb5c3c0743245adb7624b1b2608261d/users/402b104261144879a9461521f068a8ff/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:42.291791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5982b-b8d1-4a64-bde3-b177bc36f196 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:42.307526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5982b-b8d1-4a64-bde3-b177bc36f196 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:42.387576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811ae01-6027-490d-a68b-894a40f29388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:42.388327 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ae01-6027-490d-a68b-894a40f29388 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:42.388642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ae01-6027-490d-a68b-894a40f29388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:42.388923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811ae01-6027-490d-a68b-894a40f29388 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:42.390056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811ae01-6027-490d-a68b-894a40f29388 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:42.391752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4811ae01-6027-490d-a68b-894a40f29388 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:42.403969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1269/2561] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:43:42.411475 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb77fd-20f6-4ebd-a854-0745615cd457 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:42.424838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb77fd-20f6-4ebd-a854-0745615cd457 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:42.430892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a15d73-40d7-4443-98f7-626e22b3d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:42.431772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a15d73-40d7-4443-98f7-626e22b3d3bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:42.432063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a15d73-40d7-4443-98f7-626e22b3d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:42.432339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a15d73-40d7-4443-98f7-626e22b3d3bf admin admin] PATH_INFO: `/v3/projects/3bb5c3c0743245adb7624b1b2608261d/users/402b104261144879a9461521f068a8ff/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:42.434580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a15d73-40d7-4443-98f7-626e22b3d3bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bb5c3c0743245adb7624b1b2608261d, user_id=402b104261144879a9461521f068a8ff, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:42.437373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a15d73-40d7-4443-98f7-626e22b3d3bf admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:42.450353 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1293/2562] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:42 2022] PUT /identity/v3/projects/3bb5c3c0743245adb7624b1b2608261d/users/402b104261144879a9461521f068a8ff/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:42.466003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2134c0-3758-4b2c-9b75-f8de10419c6c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:42.466439 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2134c0-3758-4b2c-9b75-f8de10419c6c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:42.467023 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2134c0-3758-4b2c-9b75-f8de10419c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:42.506035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1a2134c0-3758-4b2c-9b75-f8de10419c6c None None] MFA Rules not processed for user `402b104261144879a9461521f068a8ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:42.507265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1a2134c0-3758-4b2c-9b75-f8de10419c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:42.583995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1270/2563] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:42.603733 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a15d73-40d7-4443-98f7-626e22b3d3bf admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:42.608493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-50a15d73-40d7-4443-98f7-626e22b3d3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:42.700778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a15d73-40d7-4443-98f7-626e22b3d3bf admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:42.707356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff794d-08b8-489a-810a-9950164fce3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:42.708034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff794d-08b8-489a-810a-9950164fce3c service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:42.713271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff794d-08b8-489a-810a-9950164fce3c service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:42.713271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ff794d-08b8-489a-810a-9950164fce3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:42.723498 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff794d-08b8-489a-810a-9950164fce3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:42.725028 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ff794d-08b8-489a-810a-9950164fce3c service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:42.743661 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1294/2564] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:43.009041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2134c0-3758-4b2c-9b75-f8de10419c6c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:43.013942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:43.019905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2134c0-3758-4b2c-9b75-f8de10419c6c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:43.023537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312141af-c784-4fb0-90a8-332cd4605c21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:43.025152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312141af-c784-4fb0-90a8-332cd4605c21 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:43.025152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312141af-c784-4fb0-90a8-332cd4605c21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:43.025152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312141af-c784-4fb0-90a8-332cd4605c21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:43.085797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312141af-c784-4fb0-90a8-332cd4605c21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:43.087279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312141af-c784-4fb0-90a8-332cd4605c21 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:43.097184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1271/2565] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:46.042301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff794d-08b8-489a-810a-9950164fce3c service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:46.044978 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b1ff794d-08b8-489a-810a-9950164fce3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:46.138140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ff794d-08b8-489a-810a-9950164fce3c service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:46.151414 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:46.152413 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:46.152840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:46.153121 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] PATH_INFO: `/v3/users/a2edef9a15cc417c9c43c74fc7d00b72` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:46.154753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2edef9a15cc417c9c43c74fc7d00b72)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:46.157058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:46.438566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:46.445282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2edef9a15cc417c9c43c74fc7d00b72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:46.472970 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2edef9a15cc417c9c43c74fc7d00b72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:46.546585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2edef9a15cc417c9c43c74fc7d00b72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:46.547157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2edef9a15cc417c9c43c74fc7d00b72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:46.547959 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2edef9a15cc417c9c43c74fc7d00b72'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:46.587523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1295/2566] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:46 2022] DELETE /identity/v3/users/a2edef9a15cc417c9c43c74fc7d00b72 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:46.591889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda2ae6-09e9-4a78-a198-f831eae0e172 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:46.592382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda2ae6-09e9-4a78-a198-f831eae0e172 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:46.592516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda2ae6-09e9-4a78-a198-f831eae0e172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:46.617993 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ffda2ae6-09e9-4a78-a198-f831eae0e172 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:46.620078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ffda2ae6-09e9-4a78-a198-f831eae0e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:46.717835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1272/2567] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:46.729379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:46.739785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:46.819915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0d491b-c616-4322-a755-8ba3e2e4e634 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:46.823896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b77e50-86df-4e87-b07d-07338ddfb9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:46.824669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b77e50-86df-4e87-b07d-07338ddfb9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:46.825118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b77e50-86df-4e87-b07d-07338ddfb9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:46.825475 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b77e50-86df-4e87-b07d-07338ddfb9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:46.836586 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b77e50-86df-4e87-b07d-07338ddfb9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:46.838216 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b77e50-86df-4e87-b07d-07338ddfb9f2 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:46.849785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1296/2568] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:47.376083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda2ae6-09e9-4a78-a198-f831eae0e172 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:47.385777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ffda2ae6-09e9-4a78-a198-f831eae0e172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:47.409962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda2ae6-09e9-4a78-a198-f831eae0e172 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:47.414657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:47.415532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:47.416004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:47.416283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] PATH_INFO: `/v3/projects/8f320f57b37940f3bf6008d8de238cab` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:47.417509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f320f57b37940f3bf6008d8de238cab)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:47.419454 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:47.540126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f320f57b37940f3bf6008d8de238cab', 'request_id': 'req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:47.547848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f320f57b37940f3bf6008d8de238cab', 'request_id': 'req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:47.555897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f320f57b37940f3bf6008d8de238cab', 'request_id': 'req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:47.630161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] The token cache is being invalidate because project 8f320f57b37940f3bf6008d8de238cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:47.630161 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:47.630896 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:47.632519 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1273/2569] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:47 2022] DELETE /identity/v3/projects/8f320f57b37940f3bf6008d8de238cab => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:47.636521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b77e50-86df-4e87-b07d-07338ddfb9f2 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:47.648617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b77e50-86df-4e87-b07d-07338ddfb9f2 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:47.726556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:47.727722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:47.728105 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:47.734103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] PATH_INFO: `/v3/users/b23effa26c954f9fb13d47f405d4b9db` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:47.734103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23effa26c954f9fb13d47f405d4b9db)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:47.734103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:48.211726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23effa26c954f9fb13d47f405d4b9db'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:48.227015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23effa26c954f9fb13d47f405d4b9db'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:48.229081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:48.333224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23effa26c954f9fb13d47f405d4b9db'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:48.334092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23effa26c954f9fb13d47f405d4b9db'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:48.335196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-b1978c93-d572-46b5-810f-67c77a268c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23effa26c954f9fb13d47f405d4b9db'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:48.355221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1297/2570] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:47 2022] DELETE /identity/v3/users/b23effa26c954f9fb13d47f405d4b9db => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:48.944629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:48.946905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:48.973886 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0fe65-a39d-4abf-b88a-ea87022c3ce8 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:49.016676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:49.068850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:49.070059 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.070516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.070975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] PATH_INFO: `/v3/projects/a3d6bb9ed783417a80da8eee479aae7f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.072647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3d6bb9ed783417a80da8eee479aae7f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:49.074830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:49.195943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3d6bb9ed783417a80da8eee479aae7f', 'request_id': 'req-7c5667c8-1297-4430-81aa-1d72faea4f6e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:49.202271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3d6bb9ed783417a80da8eee479aae7f', 'request_id': 'req-7c5667c8-1297-4430-81aa-1d72faea4f6e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:49.208720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3d6bb9ed783417a80da8eee479aae7f', 'request_id': 'req-7c5667c8-1297-4430-81aa-1d72faea4f6e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:49.257714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] The token cache is being invalidate because project a3d6bb9ed783417a80da8eee479aae7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:49.257925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:49.258544 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7c5667c8-1297-4430-81aa-1d72faea4f6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:49.260087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1274/2571] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:48 2022] DELETE /identity/v3/projects/a3d6bb9ed783417a80da8eee479aae7f => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:49.265859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9030-264f-4454-8d23-0f6a8830915e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.266374 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9030-264f-4454-8d23-0f6a8830915e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.266472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae9030-264f-4454-8d23-0f6a8830915e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.285109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-efae9030-264f-4454-8d23-0f6a8830915e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:49.286301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-efae9030-264f-4454-8d23-0f6a8830915e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:49.343316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1298/2572] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:49.351637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa4077-a206-4acb-9abe-6325d60ed243 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.351920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa4077-a206-4acb-9abe-6325d60ed243 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.352195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa4077-a206-4acb-9abe-6325d60ed243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.371059 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-f7aa4077-a206-4acb-9abe-6325d60ed243 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:49.372260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f7aa4077-a206-4acb-9abe-6325d60ed243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:49.380302 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1275/2573] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:49.384416 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9030-264f-4454-8d23-0f6a8830915e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:49.394695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae9030-264f-4454-8d23-0f6a8830915e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:49.399319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190436-3f6d-4b57-bf93-5f76d1ea3b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:49.399963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190436-3f6d-4b57-bf93-5f76d1ea3b4c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.400246 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190436-3f6d-4b57-bf93-5f76d1ea3b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.400550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce190436-3f6d-4b57-bf93-5f76d1ea3b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.401274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce190436-3f6d-4b57-bf93-5f76d1ea3b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:49.401590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce190436-3f6d-4b57-bf93-5f76d1ea3b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:49.403184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce190436-3f6d-4b57-bf93-5f76d1ea3b4c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:49.415087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1299/2574] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:43:49.419258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa4077-a206-4acb-9abe-6325d60ed243 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:49.428720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa4077-a206-4acb-9abe-6325d60ed243 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:49.433378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62e745-ae28-4863-9c44-e6e573cf88ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:49.434026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62e745-ae28-4863-9c44-e6e573cf88ca admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.434308 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62e745-ae28-4863-9c44-e6e573cf88ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.434585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62e745-ae28-4863-9c44-e6e573cf88ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.435274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62e745-ae28-4863-9c44-e6e573cf88ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:49.437211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d62e745-ae28-4863-9c44-e6e573cf88ca admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:49.514780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1276/2575] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:49 2022] POST /identity/v3/projects => generated 365 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:49.516571 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190436-3f6d-4b57-bf93-5f76d1ea3b4c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:49.527719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce190436-3f6d-4b57-bf93-5f76d1ea3b4c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:49.584201 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6561da5-4c22-4c14-8eb2-7eea32800278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:49.584903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6561da5-4c22-4c14-8eb2-7eea32800278 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.585184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6561da5-4c22-4c14-8eb2-7eea32800278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.585459 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6561da5-4c22-4c14-8eb2-7eea32800278 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.586144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6561da5-4c22-4c14-8eb2-7eea32800278 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:49.588069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6561da5-4c22-4c14-8eb2-7eea32800278 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:49.676033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1300/2576] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:49 2022] POST /identity/v3/users => generated 283 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:43:49.682832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62e745-ae28-4863-9c44-e6e573cf88ca admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:49.693793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62e745-ae28-4863-9c44-e6e573cf88ca admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:49.698534 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee58b-8d17-443e-9c69-5f3d0521a964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:49.699189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee58b-8d17-443e-9c69-5f3d0521a964 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.699474 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee58b-8d17-443e-9c69-5f3d0521a964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.699750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34ee58b-8d17-443e-9c69-5f3d0521a964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.700487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ee58b-8d17-443e-9c69-5f3d0521a964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:49.702089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34ee58b-8d17-443e-9c69-5f3d0521a964 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:49.713246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1277/2577] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:49.717182 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6561da5-4c22-4c14-8eb2-7eea32800278 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:49.727116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6561da5-4c22-4c14-8eb2-7eea32800278 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:49.731712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4282abe-ee5f-4d7e-8107-591eef33642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:49.732359 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4282abe-ee5f-4d7e-8107-591eef33642d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.732667 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4282abe-ee5f-4d7e-8107-591eef33642d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.732944 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4282abe-ee5f-4d7e-8107-591eef33642d admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.733696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4282abe-ee5f-4d7e-8107-591eef33642d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:49.735299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4282abe-ee5f-4d7e-8107-591eef33642d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:49.746033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1301/2578] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:49.751272 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee58b-8d17-443e-9c69-5f3d0521a964 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:49.761948 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34ee58b-8d17-443e-9c69-5f3d0521a964 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:49.766609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20876-d7b7-4cbf-82bf-060a2efb8e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:49.767988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20876-d7b7-4cbf-82bf-060a2efb8e27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.768263 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20876-d7b7-4cbf-82bf-060a2efb8e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.768572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c20876-d7b7-4cbf-82bf-060a2efb8e27 admin admin] PATH_INFO: `/v3/projects/09f95ef46de546638dbb0877bad247e3/users/9723b8a08f9c436fb1adc999079ff0a4/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.783458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c20876-d7b7-4cbf-82bf-060a2efb8e27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09f95ef46de546638dbb0877bad247e3, user_id=9723b8a08f9c436fb1adc999079ff0a4, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:49.786197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c20876-d7b7-4cbf-82bf-060a2efb8e27 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:49.891255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1278/2579] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:49 2022] PUT /identity/v3/projects/09f95ef46de546638dbb0877bad247e3/users/9723b8a08f9c436fb1adc999079ff0a4/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:49.902618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22819-82f8-4830-8b8d-cb97f88de9bc None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:49.902908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22819-82f8-4830-8b8d-cb97f88de9bc None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:49.903187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a22819-82f8-4830-8b8d-cb97f88de9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:49.933696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-b7a22819-82f8-4830-8b8d-cb97f88de9bc None None] MFA Rules not processed for user `9723b8a08f9c436fb1adc999079ff0a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:49.934917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b7a22819-82f8-4830-8b8d-cb97f88de9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:49.973749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:50.000420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1302/2580] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:49 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:50.005926 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20876-d7b7-4cbf-82bf-060a2efb8e27 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:50.056196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:50.067792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c20876-d7b7-4cbf-82bf-060a2efb8e27 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:50.072418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cb679-6a73-450f-b2dc-3e09afa2be68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:50.073098 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cb679-6a73-450f-b2dc-3e09afa2be68 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.073383 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cb679-6a73-450f-b2dc-3e09afa2be68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.073666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2cb679-6a73-450f-b2dc-3e09afa2be68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.074361 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cb679-6a73-450f-b2dc-3e09afa2be68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:50.077542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2cb679-6a73-450f-b2dc-3e09afa2be68 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:50.107640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22819-82f8-4830-8b8d-cb97f88de9bc None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:50.109450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b7a22819-82f8-4830-8b8d-cb97f88de9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:50.125219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a22819-82f8-4830-8b8d-cb97f88de9bc None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:50.130767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:50.131625 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.131905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.132179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] PATH_INFO: `/v3/users/065e7e6ec7e5491597565e64324c5686` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.133397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] RBAC: Authorizing `identity:delete_user(user_id=065e7e6ec7e5491597565e64324c5686)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:50.135314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:50.155428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1279/2581] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:50 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:50.160127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cb679-6a73-450f-b2dc-3e09afa2be68 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:50.221084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2cb679-6a73-450f-b2dc-3e09afa2be68 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:50.225934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf595ad-8f69-4d62-ab90-b40461b3fe2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:50.226637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf595ad-8f69-4d62-ab90-b40461b3fe2b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.226920 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf595ad-8f69-4d62-ab90-b40461b3fe2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.227224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf595ad-8f69-4d62-ab90-b40461b3fe2b admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.227909 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf595ad-8f69-4d62-ab90-b40461b3fe2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:50.229858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf595ad-8f69-4d62-ab90-b40461b3fe2b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:50.332623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1280/2582] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:50 2022] POST /identity/v3/users => generated 291 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:50.336264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf595ad-8f69-4d62-ab90-b40461b3fe2b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:50.347202 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf595ad-8f69-4d62-ab90-b40461b3fe2b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:50.352038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7427-0df0-4dd7-a560-023f10d9a328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:50.352731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7427-0df0-4dd7-a560-023f10d9a328 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.353154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7427-0df0-4dd7-a560-023f10d9a328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.353438 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47e7427-0df0-4dd7-a560-023f10d9a328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.353547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '065e7e6ec7e5491597565e64324c5686'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:50.354163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7427-0df0-4dd7-a560-023f10d9a328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:50.355753 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47e7427-0df0-4dd7-a560-023f10d9a328 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:50.367549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '065e7e6ec7e5491597565e64324c5686'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:50.367710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1281/2583] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:43:50.371716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7427-0df0-4dd7-a560-023f10d9a328 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:50.381318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47e7427-0df0-4dd7-a560-023f10d9a328 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:50.386123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cb97e-61ee-4b54-9b24-1084e2904050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:50.387011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cb97e-61ee-4b54-9b24-1084e2904050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.391843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cb97e-61ee-4b54-9b24-1084e2904050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.391843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69cb97e-61ee-4b54-9b24-1084e2904050 admin admin] PATH_INFO: `/v3/projects/c517d4d9c08a4ff08dc6d0cf69c1b311/users/04653b4bdf7841c9825d0bb2b2463fb3/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.402223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cb97e-61ee-4b54-9b24-1084e2904050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c517d4d9c08a4ff08dc6d0cf69c1b311, user_id=04653b4bdf7841c9825d0bb2b2463fb3, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:50.405099 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69cb97e-61ee-4b54-9b24-1084e2904050 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:50.434342 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '065e7e6ec7e5491597565e64324c5686'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:50.434952 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '065e7e6ec7e5491597565e64324c5686'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:50.435557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-e9ce489b-e062-455a-9031-e476639ea344 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '065e7e6ec7e5491597565e64324c5686'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:50.448283 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1303/2584] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:50 2022] DELETE /identity/v3/users/065e7e6ec7e5491597565e64324c5686 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:50.452702 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacba83-206a-4fb5-b1ce-556d6ee3947a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.452990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacba83-206a-4fb5-b1ce-556d6ee3947a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.453410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacba83-206a-4fb5-b1ce-556d6ee3947a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.471023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-dfacba83-206a-4fb5-b1ce-556d6ee3947a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:50.472255 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dfacba83-206a-4fb5-b1ce-556d6ee3947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:50.480417 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1282/2585] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:50 2022] PUT /identity/v3/projects/c517d4d9c08a4ff08dc6d0cf69c1b311/users/04653b4bdf7841c9825d0bb2b2463fb3/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:50.484274 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cb97e-61ee-4b54-9b24-1084e2904050 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:50.486628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e69cb97e-61ee-4b54-9b24-1084e2904050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:50.544980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1304/2586] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:50.552415 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacba83-206a-4fb5-b1ce-556d6ee3947a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:50.554077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-dfacba83-206a-4fb5-b1ce-556d6ee3947a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:50.605515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69cb97e-61ee-4b54-9b24-1084e2904050 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:50.611245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3726df-2dd6-4836-b120-c1a073df57c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:50.612183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3726df-2dd6-4836-b120-c1a073df57c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.612595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3726df-2dd6-4836-b120-c1a073df57c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.612944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3726df-2dd6-4836-b120-c1a073df57c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.613807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3726df-2dd6-4836-b120-c1a073df57c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:50.616037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3726df-2dd6-4836-b120-c1a073df57c7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:50.628766 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1283/2587] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:50 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:43:50.632897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3726df-2dd6-4836-b120-c1a073df57c7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:50.646250 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3726df-2dd6-4836-b120-c1a073df57c7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:50.651418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacba83-206a-4fb5-b1ce-556d6ee3947a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:50.657602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaeda21-58d3-42b0-9160-f3c32a960d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:50.659418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:50.661658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeda21-58d3-42b0-9160-f3c32a960d5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.661949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeda21-58d3-42b0-9160-f3c32a960d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.662234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaeda21-58d3-42b0-9160-f3c32a960d5e admin admin] PATH_INFO: `/v3/projects/c517d4d9c08a4ff08dc6d0cf69c1b311/users/04653b4bdf7841c9825d0bb2b2463fb3/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.666198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaeda21-58d3-42b0-9160-f3c32a960d5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c517d4d9c08a4ff08dc6d0cf69c1b311, user_id=04653b4bdf7841c9825d0bb2b2463fb3, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:50.669436 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaeda21-58d3-42b0-9160-f3c32a960d5e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:50.718400 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1284/2588] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:50 2022] PUT /identity/v3/projects/c517d4d9c08a4ff08dc6d0cf69c1b311/users/04653b4bdf7841c9825d0bb2b2463fb3/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:50.723842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338d21c-8b45-4b87-a1a8-fd8bcf2ce6dc None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.724320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338d21c-8b45-4b87-a1a8-fd8bcf2ce6dc None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.724924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338d21c-8b45-4b87-a1a8-fd8bcf2ce6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.763782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba013803-c8e4-437c-9249-9080cb44083a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:50.766351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013803-c8e4-437c-9249-9080cb44083a service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:50.767933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013803-c8e4-437c-9249-9080cb44083a service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:50.768202 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba013803-c8e4-437c-9249-9080cb44083a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:50.781395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:50.785936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba013803-c8e4-437c-9249-9080cb44083a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:50.787909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba013803-c8e4-437c-9249-9080cb44083a service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:50.788074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-9338d21c-8b45-4b87-a1a8-fd8bcf2ce6dc None None] MFA Rules not processed for user `04653b4bdf7841c9825d0bb2b2463fb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:50.794709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9338d21c-8b45-4b87-a1a8-fd8bcf2ce6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:50.801347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1305/2589] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:50.889774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1285/2590] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:50.905779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba013803-c8e4-437c-9249-9080cb44083a service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:50.908685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ba013803-c8e4-437c-9249-9080cb44083a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:51.020409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba013803-c8e4-437c-9249-9080cb44083a service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:51.083128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b742b-c02e-4c41-8ec1-5698dffc1f30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:51.083797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b742b-c02e-4c41-8ec1-5698dffc1f30 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:51.084230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b742b-c02e-4c41-8ec1-5698dffc1f30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:51.084536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8b742b-c02e-4c41-8ec1-5698dffc1f30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:51.100376 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b742b-c02e-4c41-8ec1-5698dffc1f30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:51.103522 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8b742b-c02e-4c41-8ec1-5698dffc1f30 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:51.130279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1306/2591] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:51.415428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338d21c-8b45-4b87-a1a8-fd8bcf2ce6dc None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:51.416906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9338d21c-8b45-4b87-a1a8-fd8bcf2ce6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:51.515064 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338d21c-8b45-4b87-a1a8-fd8bcf2ce6dc None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:51.522147 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:51.523021 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:51.523301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:51.523572 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] PATH_INFO: `/v3/projects/602e77650b9343318abf1af3b5c556af` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:51.524816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] RBAC: Authorizing `identity:delete_project(project_id=602e77650b9343318abf1af3b5c556af)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:51.526862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:51.680314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602e77650b9343318abf1af3b5c556af', 'request_id': 'req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:51.691956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602e77650b9343318abf1af3b5c556af', 'request_id': 'req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:51.701115 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602e77650b9343318abf1af3b5c556af', 'request_id': 'req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:51.796414 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] The token cache is being invalidate because project 602e77650b9343318abf1af3b5c556af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:51.796972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:51.798053 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:51.800743 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1286/2592] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:51 2022] DELETE /identity/v3/projects/602e77650b9343318abf1af3b5c556af => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:51.805178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b742b-c02e-4c41-8ec1-5698dffc1f30 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:51.817760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8b742b-c02e-4c41-8ec1-5698dffc1f30 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:51.889189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:51.890002 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:51.890284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:51.890559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] PATH_INFO: `/v3/users/2220ad601daf4c3e8ecee2700471703a` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:51.891830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=2220ad601daf4c3e8ecee2700471703a)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:51.894549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:51.912966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:52.191048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2220ad601daf4c3e8ecee2700471703a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:52.218623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2220ad601daf4c3e8ecee2700471703a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:52.292549 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2220ad601daf4c3e8ecee2700471703a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:52.293477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2220ad601daf4c3e8ecee2700471703a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:52.293869 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-000a13ad-6d54-4975-b659-80b639e0fdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2220ad601daf4c3e8ecee2700471703a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:52.312407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1307/2593] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:51 2022] DELETE /identity/v3/users/2220ad601daf4c3e8ecee2700471703a => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:52.820691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:52.822460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:52.839151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e11fad-bffb-441c-a1bb-a48ca9cc117d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:52.875450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:52.947467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:52.948691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:52.949071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:52.949444 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] PATH_INFO: `/v3/projects/87daa868ba65422499eabc6c67414837` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:52.950772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=87daa868ba65422499eabc6c67414837)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:52.952809 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:53.106011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87daa868ba65422499eabc6c67414837', 'request_id': 'req-d91db3d1-66e4-4519-9f51-d7a9753cf10a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:53.115722 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87daa868ba65422499eabc6c67414837', 'request_id': 'req-d91db3d1-66e4-4519-9f51-d7a9753cf10a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:53.122487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87daa868ba65422499eabc6c67414837', 'request_id': 'req-d91db3d1-66e4-4519-9f51-d7a9753cf10a'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:53.180320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] The token cache is being invalidate because project 87daa868ba65422499eabc6c67414837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:53.180717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:53.181339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d91db3d1-66e4-4519-9f51-d7a9753cf10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:53.182941 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1287/2594] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:52 2022] DELETE /identity/v3/projects/87daa868ba65422499eabc6c67414837 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:53.187954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732dedf-58b9-4a5b-b27b-108c6b7eab64 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:53.188738 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732dedf-58b9-4a5b-b27b-108c6b7eab64 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:53.189683 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9732dedf-58b9-4a5b-b27b-108c6b7eab64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:53.214972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-9732dedf-58b9-4a5b-b27b-108c6b7eab64 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:53.214972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9732dedf-58b9-4a5b-b27b-108c6b7eab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:53.289096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1308/2595] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:53.302074 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1c86-943e-48cb-bc93-f425b2781636 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:53.304082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1c86-943e-48cb-bc93-f425b2781636 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:53.304644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd1c86-943e-48cb-bc93-f425b2781636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:53.349037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6bfd1c86-943e-48cb-bc93-f425b2781636 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:53.353213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6bfd1c86-943e-48cb-bc93-f425b2781636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:53.372681 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1288/2596] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:53.377086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732dedf-58b9-4a5b-b27b-108c6b7eab64 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:53.401750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9732dedf-58b9-4a5b-b27b-108c6b7eab64 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:53.410792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638123-83ac-4464-abd9-46e94d319ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:53.415408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638123-83ac-4464-abd9-46e94d319ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:53.415408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638123-83ac-4464-abd9-46e94d319ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:53.415408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638123-83ac-4464-abd9-46e94d319ff2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:53.415408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0638123-83ac-4464-abd9-46e94d319ff2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:53.415408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0638123-83ac-4464-abd9-46e94d319ff2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:53.416031 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0638123-83ac-4464-abd9-46e94d319ff2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:53.446275 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1309/2597] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:43:53.451663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd1c86-943e-48cb-bc93-f425b2781636 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:53.469380 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd1c86-943e-48cb-bc93-f425b2781636 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:53.488184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ecdc6-15d0-495d-b9e5-262af7c724d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:53.489101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ecdc6-15d0-495d-b9e5-262af7c724d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:53.489750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ecdc6-15d0-495d-b9e5-262af7c724d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:53.490028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442ecdc6-15d0-495d-b9e5-262af7c724d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:53.490737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ecdc6-15d0-495d-b9e5-262af7c724d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:53.492671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442ecdc6-15d0-495d-b9e5-262af7c724d4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:53.656715 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1289/2598] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:53 2022] POST /identity/v3/projects => generated 381 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:53.663108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638123-83ac-4464-abd9-46e94d319ff2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:53.679634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638123-83ac-4464-abd9-46e94d319ff2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:53.755136 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd407d3-15ce-4708-9248-347d76a5e932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:53.755815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd407d3-15ce-4708-9248-347d76a5e932 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:53.756093 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd407d3-15ce-4708-9248-347d76a5e932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:53.756373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd407d3-15ce-4708-9248-347d76a5e932 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:53.757103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd407d3-15ce-4708-9248-347d76a5e932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:53.759065 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd407d3-15ce-4708-9248-347d76a5e932 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:53.861356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1310/2599] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:53 2022] POST /identity/v3/users => generated 291 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:53.862570 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ecdc6-15d0-495d-b9e5-262af7c724d4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:53.874256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442ecdc6-15d0-495d-b9e5-262af7c724d4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:53.881319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995e9aa-5aca-44ae-a2bb-3aefb6ac39b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:53.882008 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995e9aa-5aca-44ae-a2bb-3aefb6ac39b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:53.882428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995e9aa-5aca-44ae-a2bb-3aefb6ac39b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:53.882709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1995e9aa-5aca-44ae-a2bb-3aefb6ac39b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:53.883451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995e9aa-5aca-44ae-a2bb-3aefb6ac39b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:53.887968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1995e9aa-5aca-44ae-a2bb-3aefb6ac39b9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:53.897843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1290/2600] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:53.901914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd407d3-15ce-4708-9248-347d76a5e932 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:53.912502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:53.916682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd407d3-15ce-4708-9248-347d76a5e932 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:53.921343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79a513-72c6-4b1f-ba4f-4f22ded1fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:53.922006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79a513-72c6-4b1f-ba4f-4f22ded1fb35 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:53.922285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79a513-72c6-4b1f-ba4f-4f22ded1fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:53.922559 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79a513-72c6-4b1f-ba4f-4f22ded1fb35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:53.923308 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79a513-72c6-4b1f-ba4f-4f22ded1fb35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:53.924937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79a513-72c6-4b1f-ba4f-4f22ded1fb35 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:53.935463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1311/2601] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:53.942178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995e9aa-5aca-44ae-a2bb-3aefb6ac39b9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:53.952201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1995e9aa-5aca-44ae-a2bb-3aefb6ac39b9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:53.957737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e9784-7ad1-4f10-b01d-b591dad141e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:53.958616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e9784-7ad1-4f10-b01d-b591dad141e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:53.958916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e9784-7ad1-4f10-b01d-b591dad141e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:53.959178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e9784-7ad1-4f10-b01d-b591dad141e6 admin admin] PATH_INFO: `/v3/projects/99c2127b55294e9c8fe2463bd6f7f353/users/e4034f2e97a24bc59edd0d5b329f54cf/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:53.974300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e9784-7ad1-4f10-b01d-b591dad141e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c2127b55294e9c8fe2463bd6f7f353, user_id=e4034f2e97a24bc59edd0d5b329f54cf, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:53.977047 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e9784-7ad1-4f10-b01d-b591dad141e6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:54.085207 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1291/2602] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:53 2022] PUT /identity/v3/projects/99c2127b55294e9c8fe2463bd6f7f353/users/e4034f2e97a24bc59edd0d5b329f54cf/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:54.096992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dc7d6-bfb4-4df5-9dbc-4d6b96a9dc37 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:54.097345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dc7d6-bfb4-4df5-9dbc-4d6b96a9dc37 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:54.097640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956dc7d6-bfb4-4df5-9dbc-4d6b96a9dc37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:54.125508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-956dc7d6-bfb4-4df5-9dbc-4d6b96a9dc37 None None] MFA Rules not processed for user `e4034f2e97a24bc59edd0d5b329f54cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:54.127905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-956dc7d6-bfb4-4df5-9dbc-4d6b96a9dc37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:54.197049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1312/2603] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:54.201943 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e9784-7ad1-4f10-b01d-b591dad141e6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:54.263503 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:54.269473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e9784-7ad1-4f10-b01d-b591dad141e6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:54.274103 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32d549-2b58-4c1a-ae86-04e4867a8ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:54.277762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32d549-2b58-4c1a-ae86-04e4867a8ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:54.277762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32d549-2b58-4c1a-ae86-04e4867a8ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:54.277762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32d549-2b58-4c1a-ae86-04e4867a8ce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:54.277762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32d549-2b58-4c1a-ae86-04e4867a8ce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:54.278097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32d549-2b58-4c1a-ae86-04e4867a8ce5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:54.396569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1292/2604] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:54 2022] POST /identity/v3/projects => generated 379 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:54.400636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956dc7d6-bfb4-4df5-9dbc-4d6b96a9dc37 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:54.411410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956dc7d6-bfb4-4df5-9dbc-4d6b96a9dc37 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:54.469050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e2f8a-3b7b-47c9-a73e-3fe478d6557d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:54.469709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2f8a-3b7b-47c9-a73e-3fe478d6557d admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:54.470006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2f8a-3b7b-47c9-a73e-3fe478d6557d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:54.470451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488e2f8a-3b7b-47c9-a73e-3fe478d6557d admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:54.471148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e2f8a-3b7b-47c9-a73e-3fe478d6557d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:54.473087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488e2f8a-3b7b-47c9-a73e-3fe478d6557d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:54.613266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1313/2605] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:54 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:54.617684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32d549-2b58-4c1a-ae86-04e4867a8ce5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:54.628409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32d549-2b58-4c1a-ae86-04e4867a8ce5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:54.633034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1b322-4c0b-4edb-9c55-9331a39ba694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:54.633688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1b322-4c0b-4edb-9c55-9331a39ba694 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:54.633971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1b322-4c0b-4edb-9c55-9331a39ba694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:54.634249 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1b322-4c0b-4edb-9c55-9331a39ba694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:54.634971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1b322-4c0b-4edb-9c55-9331a39ba694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:54.636578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1b322-4c0b-4edb-9c55-9331a39ba694 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:54.647111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1293/2606] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:54.652337 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e2f8a-3b7b-47c9-a73e-3fe478d6557d admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:54.662418 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488e2f8a-3b7b-47c9-a73e-3fe478d6557d admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:54.666995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2ca5f-9529-470c-8950-5c5499eecbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:54.667860 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2ca5f-9529-470c-8950-5c5499eecbb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:54.668163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2ca5f-9529-470c-8950-5c5499eecbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:54.668547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f2ca5f-9529-470c-8950-5c5499eecbb2 admin admin] PATH_INFO: `/v3/projects/007288aea2124c31b1bb251e6b0fd5c2/users/3c6d6d8108124d1983740f0593360e92/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:54.688301 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2ca5f-9529-470c-8950-5c5499eecbb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=007288aea2124c31b1bb251e6b0fd5c2, user_id=3c6d6d8108124d1983740f0593360e92, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:54.693273 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1b322-4c0b-4edb-9c55-9331a39ba694 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:54.694252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f2ca5f-9529-470c-8950-5c5499eecbb2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:54.695010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-9fd1b322-4c0b-4edb-9c55-9331a39ba694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:54.707502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1b322-4c0b-4edb-9c55-9331a39ba694 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:54.712471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:54.713359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:54.713638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:54.714079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] PATH_INFO: `/v3/users/9723b8a08f9c436fb1adc999079ff0a4` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:54.715287 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9723b8a08f9c436fb1adc999079ff0a4)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:54.717243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:54.794493 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1314/2607] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:54 2022] PUT /identity/v3/projects/007288aea2124c31b1bb251e6b0fd5c2/users/3c6d6d8108124d1983740f0593360e92/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:54.798902 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2ca5f-9529-470c-8950-5c5499eecbb2 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:54.846112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:54.858528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f2ca5f-9529-470c-8950-5c5499eecbb2 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:54.863895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8e7cd-bf17-4757-8ff3-df4669b4a56f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:54.864808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8e7cd-bf17-4757-8ff3-df4669b4a56f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:54.865089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8e7cd-bf17-4757-8ff3-df4669b4a56f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:54.865355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f8e7cd-bf17-4757-8ff3-df4669b4a56f admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:54.866061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8e7cd-bf17-4757-8ff3-df4669b4a56f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:54.867690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f8e7cd-bf17-4757-8ff3-df4669b4a56f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:54.877354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1315/2608] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:43:54.881938 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8e7cd-bf17-4757-8ff3-df4669b4a56f admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:54.894641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f8e7cd-bf17-4757-8ff3-df4669b4a56f admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:54.899404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f247bad-d124-470c-97c3-3150a0de116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:54.903965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247bad-d124-470c-97c3-3150a0de116b admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:54.903965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247bad-d124-470c-97c3-3150a0de116b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:54.903965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f247bad-d124-470c-97c3-3150a0de116b admin admin] PATH_INFO: `/v3/projects/007288aea2124c31b1bb251e6b0fd5c2/users/3c6d6d8108124d1983740f0593360e92/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:54.903965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f247bad-d124-470c-97c3-3150a0de116b admin admin] RBAC: Authorizing `identity:create_grant(project_id=007288aea2124c31b1bb251e6b0fd5c2, user_id=3c6d6d8108124d1983740f0593360e92, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:54.905723 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f247bad-d124-470c-97c3-3150a0de116b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:54.906884 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9723b8a08f9c436fb1adc999079ff0a4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:54.914646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9723b8a08f9c436fb1adc999079ff0a4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:54.915281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9723b8a08f9c436fb1adc999079ff0a4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:54.916920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1316/2609] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:54 2022] PUT /identity/v3/projects/007288aea2124c31b1bb251e6b0fd5c2/users/3c6d6d8108124d1983740f0593360e92/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:54.927945 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba067c-3173-453a-843a-a8d4068fd036 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:54.928231 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba067c-3173-453a-843a-a8d4068fd036 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:54.928458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9723b8a08f9c436fb1adc999079ff0a4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:54.928609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba067c-3173-453a-843a-a8d4068fd036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:54.933618 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25ef9d52-23fe-42b9-b0b8-2710dd880030 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9723b8a08f9c436fb1adc999079ff0a4'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:54.956295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-49ba067c-3173-453a-843a-a8d4068fd036 None None] MFA Rules not processed for user `3c6d6d8108124d1983740f0593360e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:54.957787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-49ba067c-3173-453a-843a-a8d4068fd036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:55.007191 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1294/2610] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:54 2022] DELETE /identity/v3/users/9723b8a08f9c436fb1adc999079ff0a4 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:55.011924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae401b04-6a8d-42e7-a0bb-7816a8dd363b None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:55.012328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae401b04-6a8d-42e7-a0bb-7816a8dd363b None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:55.012737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae401b04-6a8d-42e7-a0bb-7816a8dd363b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:55.030730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ae401b04-6a8d-42e7-a0bb-7816a8dd363b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:55.031109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1317/2611] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:54 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:55.032211 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ae401b04-6a8d-42e7-a0bb-7816a8dd363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:55.042464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba067c-3173-453a-843a-a8d4068fd036 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:55.043961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-49ba067c-3173-453a-843a-a8d4068fd036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:55.104760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1295/2612] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:55.114146 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba067c-3173-453a-843a-a8d4068fd036 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:55.115666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae401b04-6a8d-42e7-a0bb-7816a8dd363b None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:55.117168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ae401b04-6a8d-42e7-a0bb-7816a8dd363b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:55.171488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:55.173397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42270bf-d160-400b-9a13-4691bf2eee3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:55.174321 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42270bf-d160-400b-9a13-4691bf2eee3f service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:55.174693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42270bf-d160-400b-9a13-4691bf2eee3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:55.175072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42270bf-d160-400b-9a13-4691bf2eee3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:55.185094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae401b04-6a8d-42e7-a0bb-7816a8dd363b None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:55.188830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf5193c-17bb-4494-9c0f-c31494882dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:55.189778 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5193c-17bb-4494-9c0f-c31494882dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:55.190062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5193c-17bb-4494-9c0f-c31494882dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:55.190367 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf5193c-17bb-4494-9c0f-c31494882dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:55.199984 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5193c-17bb-4494-9c0f-c31494882dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:55.201443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf5193c-17bb-4494-9c0f-c31494882dd8 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:55.202918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:55.211764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1296/2613] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:43:55.213081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0784-7e9d-490d-8e83-eddd7085d804 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:55.213370 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0784-7e9d-490d-8e83-eddd7085d804 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:55.213646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0da0784-7e9d-490d-8e83-eddd7085d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:55.234006 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-d0da0784-7e9d-490d-8e83-eddd7085d804 None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:55.235342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d0da0784-7e9d-490d-8e83-eddd7085d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:55.241273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42270bf-d160-400b-9a13-4691bf2eee3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:55.242856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42270bf-d160-400b-9a13-4691bf2eee3f service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:55.255745 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1318/2614] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:55.304763 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1297/2615] 10.222.0.24 () {58 vars in 967 bytes} [Wed May 25 07:43:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:55.318394 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42270bf-d160-400b-9a13-4691bf2eee3f service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:55.320243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a42270bf-d160-400b-9a13-4691bf2eee3f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:55.396855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42270bf-d160-400b-9a13-4691bf2eee3f service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:55.402307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71e14c-39e1-4a3d-9e98-1968ede8c0bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:55.402956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e14c-39e1-4a3d-9e98-1968ede8c0bb service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:55.403238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e14c-39e1-4a3d-9e98-1968ede8c0bb service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:55.403512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e14c-39e1-4a3d-9e98-1968ede8c0bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:55.417613 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71e14c-39e1-4a3d-9e98-1968ede8c0bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:55.419220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71e14c-39e1-4a3d-9e98-1968ede8c0bb service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:55.429834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1319/2616] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:43:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:43:55.733564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0784-7e9d-490d-8e83-eddd7085d804 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:55.735519 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-d0da0784-7e9d-490d-8e83-eddd7085d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:55.752538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0da0784-7e9d-490d-8e83-eddd7085d804 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:55.757398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:55.758310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:55.758649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:55.759548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] PATH_INFO: `/v3/projects/09f95ef46de546638dbb0877bad247e3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:55.760781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=09f95ef46de546638dbb0877bad247e3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:55.762725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:55.861835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71e14c-39e1-4a3d-9e98-1968ede8c0bb service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:55.863196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5e71e14c-39e1-4a3d-9e98-1968ede8c0bb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:55.876502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71e14c-39e1-4a3d-9e98-1968ede8c0bb service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:55.881537 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:55.882392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:55.882674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:55.882947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] PATH_INFO: `/v3/users/e4034f2e97a24bc59edd0d5b329f54cf` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:55.884117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4034f2e97a24bc59edd0d5b329f54cf)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:55.886115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:55.934478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09f95ef46de546638dbb0877bad247e3', 'request_id': 'req-3c9c5b5d-6c0f-401b-a678-7140619cf92b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:55.942335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09f95ef46de546638dbb0877bad247e3', 'request_id': 'req-3c9c5b5d-6c0f-401b-a678-7140619cf92b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:55.948317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09f95ef46de546638dbb0877bad247e3', 'request_id': 'req-3c9c5b5d-6c0f-401b-a678-7140619cf92b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.103369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] The token cache is being invalidate because project 09f95ef46de546638dbb0877bad247e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:56.106930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.106930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.106930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1298/2617] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:55 2022] DELETE /identity/v3/projects/09f95ef46de546638dbb0877bad247e3 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:56.109692 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:56.111500 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:56.178744 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c5b5d-6c0f-401b-a678-7140619cf92b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:56.183489 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:56.184334 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:56.184695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:56.188449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] PATH_INFO: `/v3/users/04653b4bdf7841c9825d0bb2b2463fb3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:56.188449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04653b4bdf7841c9825d0bb2b2463fb3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:56.188449 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:56.203986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:56.220087 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4034f2e97a24bc59edd0d5b329f54cf'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.232211 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4034f2e97a24bc59edd0d5b329f54cf'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.366339 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4034f2e97a24bc59edd0d5b329f54cf'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.367085 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4034f2e97a24bc59edd0d5b329f54cf'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.367809 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ea614ec8-a445-46a2-a90e-55631a36058c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4034f2e97a24bc59edd0d5b329f54cf'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.383248 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1320/2618] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:55 2022] DELETE /identity/v3/users/e4034f2e97a24bc59edd0d5b329f54cf => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:56.387556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489a0b4-c384-4537-9dad-32c2251454bd None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:56.387843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489a0b4-c384-4537-9dad-32c2251454bd None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:56.388117 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c489a0b4-c384-4537-9dad-32c2251454bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:56.405185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c489a0b4-c384-4537-9dad-32c2251454bd None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:56.406452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c489a0b4-c384-4537-9dad-32c2251454bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:56.410344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04653b4bdf7841c9825d0bb2b2463fb3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.418848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04653b4bdf7841c9825d0bb2b2463fb3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.419724 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04653b4bdf7841c9825d0bb2b2463fb3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.427847 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:56.433369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04653b4bdf7841c9825d0bb2b2463fb3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.434061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04653b4bdf7841c9825d0bb2b2463fb3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:56.466400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1321/2619] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:56.476526 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489a0b4-c384-4537-9dad-32c2251454bd None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:56.479689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c489a0b4-c384-4537-9dad-32c2251454bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:56.535889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c489a0b4-c384-4537-9dad-32c2251454bd None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:56.539529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ce3c5-ebc3-4d52-bf9d-d3fcdcdfa5ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:56.540170 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ce3c5-ebc3-4d52-bf9d-d3fcdcdfa5ea service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:56.540451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ce3c5-ebc3-4d52-bf9d-d3fcdcdfa5ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:56.540744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140ce3c5-ebc3-4d52-bf9d-d3fcdcdfa5ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:56.550544 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ce3c5-ebc3-4d52-bf9d-d3fcdcdfa5ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:56.551981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140ce3c5-ebc3-4d52-bf9d-d3fcdcdfa5ea service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:56.561657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1322/2620] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:56.574617 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1299/2621] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:56 2022] DELETE /identity/v3/users/04653b4bdf7841c9825d0bb2b2463fb3 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:57.041986 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ce3c5-ebc3-4d52-bf9d-d3fcdcdfa5ea service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:57.043598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-140ce3c5-ebc3-4d52-bf9d-d3fcdcdfa5ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:57.067794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:57.073221 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:57.083438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140ce3c5-ebc3-4d52-bf9d-d3fcdcdfa5ea service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:57.150810 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:57.151983 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:57.152428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:57.153011 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] PATH_INFO: `/v3/projects/c517d4d9c08a4ff08dc6d0cf69c1b311` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:57.154581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c517d4d9c08a4ff08dc6d0cf69c1b311)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:57.156849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:57.164168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b178a-e170-4037-8973-c641ef650d73 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:57.170044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:57.171043 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:57.171322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:57.171614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] PATH_INFO: `/v3/projects/99c2127b55294e9c8fe2463bd6f7f353` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:57.172843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c2127b55294e9c8fe2463bd6f7f353)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:57.175532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:57.331741 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c517d4d9c08a4ff08dc6d0cf69c1b311', 'request_id': 'req-9c773619-e214-4981-8b7a-57eeeb18fd8b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.334117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c2127b55294e9c8fe2463bd6f7f353', 'request_id': 'req-ffc48928-a667-495e-88d9-82300a06fe50'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.338865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c517d4d9c08a4ff08dc6d0cf69c1b311', 'request_id': 'req-9c773619-e214-4981-8b7a-57eeeb18fd8b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.340654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c2127b55294e9c8fe2463bd6f7f353', 'request_id': 'req-ffc48928-a667-495e-88d9-82300a06fe50'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.344590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c517d4d9c08a4ff08dc6d0cf69c1b311', 'request_id': 'req-9c773619-e214-4981-8b7a-57eeeb18fd8b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.347081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c2127b55294e9c8fe2463bd6f7f353', 'request_id': 'req-ffc48928-a667-495e-88d9-82300a06fe50'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.491583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] The token cache is being invalidate because project c517d4d9c08a4ff08dc6d0cf69c1b311 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:57.491898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.492467 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9c773619-e214-4981-8b7a-57eeeb18fd8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.494043 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1323/2622] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:57 2022] DELETE /identity/v3/projects/c517d4d9c08a4ff08dc6d0cf69c1b311 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:57.498721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee68aa-c8f7-4ed1-87d7-7bafde84de92 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:57.499004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee68aa-c8f7-4ed1-87d7-7bafde84de92 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:57.499282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee68aa-c8f7-4ed1-87d7-7bafde84de92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:57.517108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-15ee68aa-c8f7-4ed1-87d7-7bafde84de92 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:57.518876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-15ee68aa-c8f7-4ed1-87d7-7bafde84de92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:57.578756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1324/2623] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:57.587169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13a543-dc68-40f6-b4b8-9b619bf565b3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:57.587458 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13a543-dc68-40f6-b4b8-9b619bf565b3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:57.587778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13a543-dc68-40f6-b4b8-9b619bf565b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:57.606676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-ee13a543-dc68-40f6-b4b8-9b619bf565b3 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:57.607894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ee13a543-dc68-40f6-b4b8-9b619bf565b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:57.613663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] The token cache is being invalidate because project 99c2127b55294e9c8fe2463bd6f7f353 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:57.613663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.613663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.614426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1300/2624] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:57 2022] DELETE /identity/v3/projects/99c2127b55294e9c8fe2463bd6f7f353 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:57.619768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1325/2625] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:57.619934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:57.619934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:57.620788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13a543-dc68-40f6-b4b8-9b619bf565b3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:57.631472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13a543-dc68-40f6-b4b8-9b619bf565b3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:57.632548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc48928-a667-495e-88d9-82300a06fe50 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:57.636020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:57.636726 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:57.637009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:57.637129 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:57.637340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:57.637950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:57.638077 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:57.638238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:57.638348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:57.638695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] PATH_INFO: `/v3/users/3c6d6d8108124d1983740f0593360e92` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:57.639663 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6d6d8108124d1983740f0593360e92)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:57.639973 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:57.641610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:57.655835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1326/2626] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:43:57.656795 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:57.659204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:57.672224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ffdb5-e8e3-4a37-ad04-dec761c2a74c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:57.676971 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c8aee-c35a-4b3f-9c45-9f2cd5e149e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:57.677618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c8aee-c35a-4b3f-9c45-9f2cd5e149e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:57.677901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c8aee-c35a-4b3f-9c45-9f2cd5e149e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:57.678203 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c8aee-c35a-4b3f-9c45-9f2cd5e149e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:57.678886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c8aee-c35a-4b3f-9c45-9f2cd5e149e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:57.680802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c8aee-c35a-4b3f-9c45-9f2cd5e149e4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:57.773119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:57.782902 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1327/2627] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:57 2022] POST /identity/v3/projects => generated 367 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:43:57.783877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c8aee-c35a-4b3f-9c45-9f2cd5e149e4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:57.838473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6d6d8108124d1983740f0593360e92'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.845488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6d6d8108124d1983740f0593360e92'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.845665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c8aee-c35a-4b3f-9c45-9f2cd5e149e4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:57.846168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6d6d8108124d1983740f0593360e92'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.850371 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d255-4bb3-4689-b3de-cb6ad34b6fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:57.852429 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d255-4bb3-4689-b3de-cb6ad34b6fd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:57.852753 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d255-4bb3-4689-b3de-cb6ad34b6fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:57.853035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505d255-4bb3-4689-b3de-cb6ad34b6fd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:57.853725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505d255-4bb3-4689-b3de-cb6ad34b6fd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:57.855646 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505d255-4bb3-4689-b3de-cb6ad34b6fd9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:57.857879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6d6d8108124d1983740f0593360e92'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.859465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6d6d8108124d1983740f0593360e92'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:57.945756 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:57.949698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1301/2628] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:57 2022] DELETE /identity/v3/users/3c6d6d8108124d1983740f0593360e92 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:57.954611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1328/2629] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:57 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:43:57.956659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:57.958415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:58.024586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47656767-185e-4b90-bbe5-2ed6eec72bd2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:58.029412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd614-6e7a-4f0f-a8bb-61e586868f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:58.030124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd614-6e7a-4f0f-a8bb-61e586868f94 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.030412 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd614-6e7a-4f0f-a8bb-61e586868f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.030695 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5dd614-6e7a-4f0f-a8bb-61e586868f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.031487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dd614-6e7a-4f0f-a8bb-61e586868f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:58.033212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5dd614-6e7a-4f0f-a8bb-61e586868f94 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:58.044350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1302/2630] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:58.049184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d255-4bb3-4689-b3de-cb6ad34b6fd9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:58.059438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505d255-4bb3-4689-b3de-cb6ad34b6fd9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:58.064200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd701be4-d7db-4eb8-9a72-e3469ec9bb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:58.065399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701be4-d7db-4eb8-9a72-e3469ec9bb84 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.065679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701be4-d7db-4eb8-9a72-e3469ec9bb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.065953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd701be4-d7db-4eb8-9a72-e3469ec9bb84 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.066673 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd701be4-d7db-4eb8-9a72-e3469ec9bb84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:58.068310 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd701be4-d7db-4eb8-9a72-e3469ec9bb84 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:58.078316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1329/2631] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:58.084794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd614-6e7a-4f0f-a8bb-61e586868f94 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:58.095039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5dd614-6e7a-4f0f-a8bb-61e586868f94 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:58.099748 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683f69-5f16-414b-be6a-df60d348dbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:58.100679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683f69-5f16-414b-be6a-df60d348dbc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.100972 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683f69-5f16-414b-be6a-df60d348dbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.101252 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40683f69-5f16-414b-be6a-df60d348dbc7 admin admin] PATH_INFO: `/v3/projects/badf4c6a4c434cc7bb6feeccf8bd71e4/users/d1f81ffaae2844918caac919c76eeaad/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.119113 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683f69-5f16-414b-be6a-df60d348dbc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=badf4c6a4c434cc7bb6feeccf8bd71e4, user_id=d1f81ffaae2844918caac919c76eeaad, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:58.121488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40683f69-5f16-414b-be6a-df60d348dbc7 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:58.242809 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1303/2632] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:58 2022] PUT /identity/v3/projects/badf4c6a4c434cc7bb6feeccf8bd71e4/users/d1f81ffaae2844918caac919c76eeaad/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:58.254384 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825e665-5065-4d71-90de-09c7532b00b3 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.254676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825e665-5065-4d71-90de-09c7532b00b3 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.254961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825e665-5065-4d71-90de-09c7532b00b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.286965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f825e665-5065-4d71-90de-09c7532b00b3 None None] MFA Rules not processed for user `d1f81ffaae2844918caac919c76eeaad`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:58.288191 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f825e665-5065-4d71-90de-09c7532b00b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:58.365116 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1330/2633] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:58.372525 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683f69-5f16-414b-be6a-df60d348dbc7 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:58.444310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40683f69-5f16-414b-be6a-df60d348dbc7 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:58.457430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f7bc6-32c9-4526-a09c-0e385eb9a619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:58.457430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f7bc6-32c9-4526-a09c-0e385eb9a619 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.457430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f7bc6-32c9-4526-a09c-0e385eb9a619 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.457430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f7bc6-32c9-4526-a09c-0e385eb9a619 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.457786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f7bc6-32c9-4526-a09c-0e385eb9a619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:58.459986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f7bc6-32c9-4526-a09c-0e385eb9a619 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:58.512009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825e665-5065-4d71-90de-09c7532b00b3 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:58.513855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f825e665-5065-4d71-90de-09c7532b00b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:58.536737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825e665-5065-4d71-90de-09c7532b00b3 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:58.542472 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:58.543424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.543899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.544182 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] PATH_INFO: `/v3/projects/007288aea2124c31b1bb251e6b0fd5c2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.545642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=007288aea2124c31b1bb251e6b0fd5c2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:58.549055 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:58.592537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1304/2634] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:58 2022] POST /identity/v3/projects => generated 367 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:58.597259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f7bc6-32c9-4526-a09c-0e385eb9a619 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:58.666593 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f7bc6-32c9-4526-a09c-0e385eb9a619 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:58.671930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31017bb-3411-4e9a-b7e7-249e615a828b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:58.672758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31017bb-3411-4e9a-b7e7-249e615a828b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.672915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31017bb-3411-4e9a-b7e7-249e615a828b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.673320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31017bb-3411-4e9a-b7e7-249e615a828b admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.674109 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31017bb-3411-4e9a-b7e7-249e615a828b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:58.676208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31017bb-3411-4e9a-b7e7-249e615a828b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:58.683947 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '007288aea2124c31b1bb251e6b0fd5c2', 'request_id': 'req-ce57b5cf-7d12-45c8-bc06-2312912d0a61'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:58.691108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '007288aea2124c31b1bb251e6b0fd5c2', 'request_id': 'req-ce57b5cf-7d12-45c8-bc06-2312912d0a61'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:58.696994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '007288aea2124c31b1bb251e6b0fd5c2', 'request_id': 'req-ce57b5cf-7d12-45c8-bc06-2312912d0a61'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:58.734372 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:58.806557 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] The token cache is being invalidate because project 007288aea2124c31b1bb251e6b0fd5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:58.806851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:58.807553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:58.808119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1305/2635] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:58 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:58.809210 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1331/2636] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:58 2022] DELETE /identity/v3/projects/007288aea2124c31b1bb251e6b0fd5c2 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:58.812251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:58.813914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:58.815482 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69b652-ee06-453b-95a0-850eaabcaaff None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.815774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69b652-ee06-453b-95a0-850eaabcaaff None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.816056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e69b652-ee06-453b-95a0-850eaabcaaff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.835834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2e69b652-ee06-453b-95a0-850eaabcaaff None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:58.837084 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2e69b652-ee06-453b-95a0-850eaabcaaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:58.849198 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:58.889257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57b5cf-7d12-45c8-bc06-2312912d0a61 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:58.895650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a39644-afbd-4d44-b0f3-1b95c27d7438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:58.899566 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a39644-afbd-4d44-b0f3-1b95c27d7438 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.899898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a39644-afbd-4d44-b0f3-1b95c27d7438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.900178 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a39644-afbd-4d44-b0f3-1b95c27d7438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.900985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a39644-afbd-4d44-b0f3-1b95c27d7438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:58.902627 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a39644-afbd-4d44-b0f3-1b95c27d7438 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:58.915939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1332/2637] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:58.916819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1306/2638] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:58.916936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a39644-afbd-4d44-b0f3-1b95c27d7438 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:58.918574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-67a39644-afbd-4d44-b0f3-1b95c27d7438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:58.920532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f994-dd25-475b-bd5d-b08a771f6bda None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.920990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f994-dd25-475b-bd5d-b08a771f6bda None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.921465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7f994-dd25-475b-bd5d-b08a771f6bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.933129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a39644-afbd-4d44-b0f3-1b95c27d7438 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:58.944533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:58.944533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.944533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.944533 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] PATH_INFO: `/v3/users/c92e8b7fc090454c9498afef1d79e4bc` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.944930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92e8b7fc090454c9498afef1d79e4bc)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:58.944930 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:58.945346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a8c7f994-dd25-475b-bd5d-b08a771f6bda None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:58.946558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a8c7f994-dd25-475b-bd5d-b08a771f6bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:58.958562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1307/2639] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:58.958562 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7f994-dd25-475b-bd5d-b08a771f6bda None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:58.968366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7f994-dd25-475b-bd5d-b08a771f6bda None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:58.973840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c64e6-8961-4248-a643-b47bf1c038fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:58.974730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c64e6-8961-4248-a643-b47bf1c038fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:58.975017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c64e6-8961-4248-a643-b47bf1c038fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:58.977237 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c64e6-8961-4248-a643-b47bf1c038fe admin admin] PATH_INFO: `/v3/projects/62b9b81ffb0b4fa4ae51b66fc6e45743/users/256b8a5083414610bd34f5b2848dedad/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:58.991183 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c64e6-8961-4248-a643-b47bf1c038fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b9b81ffb0b4fa4ae51b66fc6e45743, user_id=256b8a5083414610bd34f5b2848dedad, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:58.994070 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c64e6-8961-4248-a643-b47bf1c038fe admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.093879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1308/2640] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:58 2022] PUT /identity/v3/projects/62b9b81ffb0b4fa4ae51b66fc6e45743/users/256b8a5083414610bd34f5b2848dedad/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:59.094808 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c64e6-8961-4248-a643-b47bf1c038fe admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.156304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c64e6-8961-4248-a643-b47bf1c038fe admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.161541 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e69252-96e0-4c5b-9e77-779a28d5af99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.162197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e69252-96e0-4c5b-9e77-779a28d5af99 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.162481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e69252-96e0-4c5b-9e77-779a28d5af99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.162758 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e69252-96e0-4c5b-9e77-779a28d5af99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.163595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e69252-96e0-4c5b-9e77-779a28d5af99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:43:59.163907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e69252-96e0-4c5b-9e77-779a28d5af99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.165553 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e69252-96e0-4c5b-9e77-779a28d5af99 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.177603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1309/2641] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:43:59.178561 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e69252-96e0-4c5b-9e77-779a28d5af99 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.181349 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92e8b7fc090454c9498afef1d79e4bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.189135 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e69252-96e0-4c5b-9e77-779a28d5af99 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.194366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92e8b7fc090454c9498afef1d79e4bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.194498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1db49-0749-433b-8171-289c7e85e5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.195124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1db49-0749-433b-8171-289c7e85e5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.195406 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1db49-0749-433b-8171-289c7e85e5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.195682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1db49-0749-433b-8171-289c7e85e5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.196399 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1db49-0749-433b-8171-289c7e85e5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.198015 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1db49-0749-433b-8171-289c7e85e5c4 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.208660 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1310/2642] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:59.212626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1db49-0749-433b-8171-289c7e85e5c4 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.219487 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1db49-0749-433b-8171-289c7e85e5c4 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.224625 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c7ec7-04ce-4e16-97db-b7a64ce72e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.225291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7ec7-04ce-4e16-97db-b7a64ce72e1f admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.225579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7ec7-04ce-4e16-97db-b7a64ce72e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.225860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67c7ec7-04ce-4e16-97db-b7a64ce72e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.226582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c7ec7-04ce-4e16-97db-b7a64ce72e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.228469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67c7ec7-04ce-4e16-97db-b7a64ce72e1f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.275140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92e8b7fc090454c9498afef1d79e4bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.275754 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92e8b7fc090454c9498afef1d79e4bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.276406 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92e8b7fc090454c9498afef1d79e4bc'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.288977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1333/2643] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:43:58 2022] DELETE /identity/v3/users/c92e8b7fc090454c9498afef1d79e4bc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:59.289725 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.291064 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:59.357010 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9184dc8c-59f6-4d2b-8384-d8c5a9ddfbb5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.362204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46104b56-f754-4611-ba8e-e43ac66f5079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.363090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46104b56-f754-4611-ba8e-e43ac66f5079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.363369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46104b56-f754-4611-ba8e-e43ac66f5079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.369033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46104b56-f754-4611-ba8e-e43ac66f5079 admin admin] PATH_INFO: `/v3/projects/62b9b81ffb0b4fa4ae51b66fc6e45743/users/256b8a5083414610bd34f5b2848dedad/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.369033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46104b56-f754-4611-ba8e-e43ac66f5079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62b9b81ffb0b4fa4ae51b66fc6e45743, user_id=256b8a5083414610bd34f5b2848dedad, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.369033 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46104b56-f754-4611-ba8e-e43ac66f5079 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.380245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1334/2644] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:59 2022] PUT /identity/v3/projects/62b9b81ffb0b4fa4ae51b66fc6e45743/users/256b8a5083414610bd34f5b2848dedad/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:59.390329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8333-e66f-49de-9c6f-008b632392c7 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.390842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8333-e66f-49de-9c6f-008b632392c7 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.391127 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f8333-e66f-49de-9c6f-008b632392c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.404317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1311/2645] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:43:59 2022] POST /identity/v3/projects => generated 383 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:43:59.408457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c7ec7-04ce-4e16-97db-b7a64ce72e1f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.410916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a67c7ec7-04ce-4e16-97db-b7a64ce72e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:59.420598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-378f8333-e66f-49de-9c6f-008b632392c7 None None] MFA Rules not processed for user `256b8a5083414610bd34f5b2848dedad`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:59.421940 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-378f8333-e66f-49de-9c6f-008b632392c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:59.492153 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67c7ec7-04ce-4e16-97db-b7a64ce72e1f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.498670 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1335/2646] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:43:59.500569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ace5-ab0c-45c8-be1e-4ec75c37f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.501254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ace5-ab0c-45c8-be1e-4ec75c37f8de admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.501602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ace5-ab0c-45c8-be1e-4ec75c37f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.502451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6361ace5-ab0c-45c8-be1e-4ec75c37f8de admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.503529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ace5-ab0c-45c8-be1e-4ec75c37f8de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.505509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6361ace5-ab0c-45c8-be1e-4ec75c37f8de admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.510469 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8333-e66f-49de-9c6f-008b632392c7 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.511825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-378f8333-e66f-49de-9c6f-008b632392c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:59.570839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f8333-e66f-49de-9c6f-008b632392c7 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.574570 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eca3c-1cbf-42d8-87f8-e6df786dd355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.575220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eca3c-1cbf-42d8-87f8-e6df786dd355 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.575503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eca3c-1cbf-42d8-87f8-e6df786dd355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.575779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753eca3c-1cbf-42d8-87f8-e6df786dd355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.589169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753eca3c-1cbf-42d8-87f8-e6df786dd355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.589844 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753eca3c-1cbf-42d8-87f8-e6df786dd355 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.600675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1336/2647] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:43:59.601536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eca3c-1cbf-42d8-87f8-e6df786dd355 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.602819 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-753eca3c-1cbf-42d8-87f8-e6df786dd355 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:59.615539 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1312/2648] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:43:59 2022] POST /identity/v3/users => generated 292 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:43:59.617285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753eca3c-1cbf-42d8-87f8-e6df786dd355 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.619641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ace5-ab0c-45c8-be1e-4ec75c37f8de admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.622575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.623553 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.624089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.624212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] PATH_INFO: `/v3/projects/c16634316fc64493aef03cf073514273` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.625425 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c16634316fc64493aef03cf073514273)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.627899 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.631288 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6361ace5-ab0c-45c8-be1e-4ec75c37f8de admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.632236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:59.636910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635147-0bf5-4678-a06b-077d00344bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.638454 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635147-0bf5-4678-a06b-077d00344bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.638863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635147-0bf5-4678-a06b-077d00344bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.639151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d635147-0bf5-4678-a06b-077d00344bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.640107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d635147-0bf5-4678-a06b-077d00344bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.641986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d635147-0bf5-4678-a06b-077d00344bc9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.655563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1313/2649] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:59.657044 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635147-0bf5-4678-a06b-077d00344bc9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.667786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d635147-0bf5-4678-a06b-077d00344bc9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.672335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b68c6-ed51-4984-8089-a5c8607f1d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.673011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b68c6-ed51-4984-8089-a5c8607f1d1e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.673300 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b68c6-ed51-4984-8089-a5c8607f1d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.674292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b68c6-ed51-4984-8089-a5c8607f1d1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.675141 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b68c6-ed51-4984-8089-a5c8607f1d1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.676767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b68c6-ed51-4984-8089-a5c8607f1d1e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.689429 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1314/2650] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:43:59.690768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b68c6-ed51-4984-8089-a5c8607f1d1e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.700329 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b68c6-ed51-4984-8089-a5c8607f1d1e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.705151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e29afc1-5467-45e0-9bf7-c66fcb3a794c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.706026 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29afc1-5467-45e0-9bf7-c66fcb3a794c admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.706299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29afc1-5467-45e0-9bf7-c66fcb3a794c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.706573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e29afc1-5467-45e0-9bf7-c66fcb3a794c admin admin] PATH_INFO: `/v3/projects/8777d5e80dd740fc9e6ef0d528f26884/users/3458b45d4fc74c1cbf6483b4d6211619/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.723600 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29afc1-5467-45e0-9bf7-c66fcb3a794c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8777d5e80dd740fc9e6ef0d528f26884, user_id=3458b45d4fc74c1cbf6483b4d6211619, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:43:59.726507 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e29afc1-5467-45e0-9bf7-c66fcb3a794c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:43:59.807136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1315/2651] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:43:59 2022] PUT /identity/v3/projects/8777d5e80dd740fc9e6ef0d528f26884/users/3458b45d4fc74c1cbf6483b4d6211619/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:43:59.814372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c16634316fc64493aef03cf073514273', 'request_id': 'req-a35e3834-7e64-47ff-9c83-671ced8c0b11'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.819685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af398904-2188-4bb9-b6d3-9ee94e511ea5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.819978 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af398904-2188-4bb9-b6d3-9ee94e511ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.820261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af398904-2188-4bb9-b6d3-9ee94e511ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.821097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c16634316fc64493aef03cf073514273', 'request_id': 'req-a35e3834-7e64-47ff-9c83-671ced8c0b11'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.826619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c16634316fc64493aef03cf073514273', 'request_id': 'req-a35e3834-7e64-47ff-9c83-671ced8c0b11'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.847298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-af398904-2188-4bb9-b6d3-9ee94e511ea5 None None] MFA Rules not processed for user `3458b45d4fc74c1cbf6483b4d6211619`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:43:59.848580 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-af398904-2188-4bb9-b6d3-9ee94e511ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:59.913563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1316/2652] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:43:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:43:59.914584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af398904-2188-4bb9-b6d3-9ee94e511ea5 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.929134 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] The token cache is being invalidate because project c16634316fc64493aef03cf073514273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:43:59.929428 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.934460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:43:59.934460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1337/2653] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:43:59 2022] DELETE /identity/v3/projects/c16634316fc64493aef03cf073514273 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:43:59.934460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:43:59.934460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:59.971001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af398904-2188-4bb9-b6d3-9ee94e511ea5 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.976635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f8045-e8bd-457b-a4ce-12993a8c519e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.977505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f8045-e8bd-457b-a4ce-12993a8c519e service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:43:59.977787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f8045-e8bd-457b-a4ce-12993a8c519e service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:43:59.978065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f8045-e8bd-457b-a4ce-12993a8c519e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:43:59.980143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-454f8045-e8bd-457b-a4ce-12993a8c519e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:43:59.995460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35e3834-7e64-47ff-9c83-671ced8c0b11 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:43:59.999212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ffb00a-c9e7-4f30-8f12-ecd84e94974b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:43:59.999868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffb00a-c9e7-4f30-8f12-ecd84e94974b service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.000205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffb00a-c9e7-4f30-8f12-ecd84e94974b service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.000513 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ffb00a-c9e7-4f30-8f12-ecd84e94974b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.002729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f0ffb00a-c9e7-4f30-8f12-ecd84e94974b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:00.013759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffb00a-c9e7-4f30-8f12-ecd84e94974b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:00.019521 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ffb00a-c9e7-4f30-8f12-ecd84e94974b service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:00.025362 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1338/2654] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:00.026825 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35733-aaf3-4d6a-a6ef-6498be681456 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.027115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35733-aaf3-4d6a-a6ef-6498be681456 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.027400 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b35733-aaf3-4d6a-a6ef-6498be681456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.040701 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:00.044717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f8045-e8bd-457b-a4ce-12993a8c519e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:00.046260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f8045-e8bd-457b-a4ce-12993a8c519e service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:00.048587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f7b35733-aaf3-4d6a-a6ef-6498be681456 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:00.050009 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f7b35733-aaf3-4d6a-a6ef-6498be681456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:00.056874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1317/2655] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:43:59 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:00.120620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1339/2656] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:00.128513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e799bf1-b4cc-40fb-b281-542c65cceb60 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.129056 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e799bf1-b4cc-40fb-b281-542c65cceb60 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.129209 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e799bf1-b4cc-40fb-b281-542c65cceb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.150847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3e799bf1-b4cc-40fb-b281-542c65cceb60 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:00.153147 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3e799bf1-b4cc-40fb-b281-542c65cceb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:00.161061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1318/2657] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:00.165639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35733-aaf3-4d6a-a6ef-6498be681456 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:00.176325 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b35733-aaf3-4d6a-a6ef-6498be681456 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:00.181090 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9f636-4d77-49d2-9920-b693c38305f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:00.181773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9f636-4d77-49d2-9920-b693c38305f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.182059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9f636-4d77-49d2-9920-b693c38305f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.182364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed9f636-4d77-49d2-9920-b693c38305f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.183101 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9f636-4d77-49d2-9920-b693c38305f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:44:00.183409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9f636-4d77-49d2-9920-b693c38305f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:00.185074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed9f636-4d77-49d2-9920-b693c38305f7 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:00.198724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1340/2658] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:44:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:44:00.203261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e799bf1-b4cc-40fb-b281-542c65cceb60 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:00.212825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e799bf1-b4cc-40fb-b281-542c65cceb60 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:00.217529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57437a-017e-48cf-823a-dc056e624b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:00.218182 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57437a-017e-48cf-823a-dc056e624b89 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.218469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57437a-017e-48cf-823a-dc056e624b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.218744 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa57437a-017e-48cf-823a-dc056e624b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.219445 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57437a-017e-48cf-823a-dc056e624b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:00.221865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa57437a-017e-48cf-823a-dc056e624b89 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:00.376995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1319/2659] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:00 2022] POST /identity/v3/projects => generated 383 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:00.378262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9f636-4d77-49d2-9920-b693c38305f7 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:00.389783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed9f636-4d77-49d2-9920-b693c38305f7 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:00.445649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d3524-2bec-4e4d-bbdb-5c627ca193bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:00.446320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d3524-2bec-4e4d-bbdb-5c627ca193bc admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.446604 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d3524-2bec-4e4d-bbdb-5c627ca193bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.446882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d3524-2bec-4e4d-bbdb-5c627ca193bc admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.447569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d3524-2bec-4e4d-bbdb-5c627ca193bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:00.449540 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d3524-2bec-4e4d-bbdb-5c627ca193bc admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:00.560597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:00.566812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1341/2660] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:00 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:44:00.570875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57437a-017e-48cf-823a-dc056e624b89 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:00.581422 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa57437a-017e-48cf-823a-dc056e624b89 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:00.586471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb4fb2-a716-47d0-83bc-ae595f5dd2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:00.587148 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb4fb2-a716-47d0-83bc-ae595f5dd2df admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.587432 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb4fb2-a716-47d0-83bc-ae595f5dd2df admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.587708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cb4fb2-a716-47d0-83bc-ae595f5dd2df admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.588499 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb4fb2-a716-47d0-83bc-ae595f5dd2df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:00.590509 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cb4fb2-a716-47d0-83bc-ae595f5dd2df admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:00.605568 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1320/2661] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:00.606854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d3524-2bec-4e4d-bbdb-5c627ca193bc admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:00.618227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d3524-2bec-4e4d-bbdb-5c627ca193bc admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:00.622991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcba8edc-c908-45d6-8e3d-a21dd72b299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:00.623641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba8edc-c908-45d6-8e3d-a21dd72b299f admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.623923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba8edc-c908-45d6-8e3d-a21dd72b299f admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.624196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcba8edc-c908-45d6-8e3d-a21dd72b299f admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.624963 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba8edc-c908-45d6-8e3d-a21dd72b299f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:00.626582 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcba8edc-c908-45d6-8e3d-a21dd72b299f admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:00.636820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1342/2662] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:00.641137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb4fb2-a716-47d0-83bc-ae595f5dd2df admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:00.651426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cb4fb2-a716-47d0-83bc-ae595f5dd2df admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:00.656175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d4c53-ca16-49b5-80b5-3dc7ace2fb5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:00.658416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d4c53-ca16-49b5-80b5-3dc7ace2fb5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.658416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d4c53-ca16-49b5-80b5-3dc7ace2fb5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.658416 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d4c53-ca16-49b5-80b5-3dc7ace2fb5c admin admin] PATH_INFO: `/v3/projects/ee2590cbdba14e7ab1f3ce5a58beeb54/users/820809022ed4493eb9f536c3b1fbc878/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.663107 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:00.672795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d4c53-ca16-49b5-80b5-3dc7ace2fb5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee2590cbdba14e7ab1f3ce5a58beeb54, user_id=820809022ed4493eb9f536c3b1fbc878, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:00.676061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3d4c53-ca16-49b5-80b5-3dc7ace2fb5c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:00.768332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1321/2663] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:00 2022] PUT /identity/v3/projects/ee2590cbdba14e7ab1f3ce5a58beeb54/users/820809022ed4493eb9f536c3b1fbc878/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:00.773729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217f0e1-39bd-45d2-9d5e-448a5608bcc8 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.774018 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217f0e1-39bd-45d2-9d5e-448a5608bcc8 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.774293 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5217f0e1-39bd-45d2-9d5e-448a5608bcc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.804507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-5217f0e1-39bd-45d2-9d5e-448a5608bcc8 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:00.804507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5217f0e1-39bd-45d2-9d5e-448a5608bcc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:00.855833 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1343/2664] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:00.865730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d4c53-ca16-49b5-80b5-3dc7ace2fb5c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:00.867531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-de3d4c53-ca16-49b5-80b5-3dc7ace2fb5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:00.942462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3d4c53-ca16-49b5-80b5-3dc7ace2fb5c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:00.946223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf8802-e1b9-4473-91ec-344714ef956d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:00.946923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf8802-e1b9-4473-91ec-344714ef956d service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:00.947206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf8802-e1b9-4473-91ec-344714ef956d service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:00.947504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf8802-e1b9-4473-91ec-344714ef956d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:00.957712 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf8802-e1b9-4473-91ec-344714ef956d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:00.959242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf8802-e1b9-4473-91ec-344714ef956d service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:00.968734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1322/2665] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:00.995124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:01.315528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:02.396445 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7276a-e157-48d6-9a29-d07208022211 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:02.397067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7276a-e157-48d6-9a29-d07208022211 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:02.397067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b7276a-e157-48d6-9a29-d07208022211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:02.425875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-88b7276a-e157-48d6-9a29-d07208022211 None None] MFA Rules not processed for user `820809022ed4493eb9f536c3b1fbc878`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:02.427076 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-88b7276a-e157-48d6-9a29-d07208022211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:02.491868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:02.495984 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1344/2666] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:02.507225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf8802-e1b9-4473-91ec-344714ef956d service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:02.508807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-55bf8802-e1b9-4473-91ec-344714ef956d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:02.569325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf8802-e1b9-4473-91ec-344714ef956d service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:02.572933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ff6af-75d7-42f0-81be-674f726d06e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:02.573578 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ff6af-75d7-42f0-81be-674f726d06e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:02.573862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ff6af-75d7-42f0-81be-674f726d06e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:02.574136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ff6af-75d7-42f0-81be-674f726d06e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:02.583594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ff6af-75d7-42f0-81be-674f726d06e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:02.585077 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ff6af-75d7-42f0-81be-674f726d06e2 service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:02.594535 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1323/2667] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:44:06.635347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18463b-09b7-43cc-b550-d5a9a9355032 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:06.635909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18463b-09b7-43cc-b550-d5a9a9355032 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:06.635909 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18463b-09b7-43cc-b550-d5a9a9355032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:06.653639 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1f18463b-09b7-43cc-b550-d5a9a9355032 None None] MFA Rules not processed for user `820809022ed4493eb9f536c3b1fbc878`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:06.654849 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1f18463b-09b7-43cc-b550-d5a9a9355032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:06.663232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1345/2668] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:07.588054 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ff6af-75d7-42f0-81be-674f726d06e2 service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:07.589594 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-df3ff6af-75d7-42f0-81be-674f726d06e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:07.603820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ff6af-75d7-42f0-81be-674f726d06e2 service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:07.608597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:07.609465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:07.609749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:07.610080 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] PATH_INFO: `/v3/users/d1f81ffaae2844918caac919c76eeaad` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:07.611953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1f81ffaae2844918caac919c76eeaad)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:07.614033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:07.889788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1f81ffaae2844918caac919c76eeaad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:07.903096 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1f81ffaae2844918caac919c76eeaad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:07.908582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1f81ffaae2844918caac919c76eeaad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:07.917584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1f81ffaae2844918caac919c76eeaad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:07.918223 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1f81ffaae2844918caac919c76eeaad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:08.023255 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1324/2669] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:07 2022] DELETE /identity/v3/users/d1f81ffaae2844918caac919c76eeaad => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:08.024550 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a4ba-f697-4614-b7c6-ddee356f1ef2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:08.025025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a4ba-f697-4614-b7c6-ddee356f1ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:08.025139 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e533a4ba-f697-4614-b7c6-ddee356f1ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:08.043736 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e533a4ba-f697-4614-b7c6-ddee356f1ef2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:08.046067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e533a4ba-f697-4614-b7c6-ddee356f1ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:08.109368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1346/2670] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:44:08.120659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:08.122488 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:08.186259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f34034-3dae-414b-aa05-1eb4aee9a049 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:08.190326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02849-9848-4ea6-b17b-f4ec9ffd839a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:08.190975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02849-9848-4ea6-b17b-f4ec9ffd839a service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:08.191254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02849-9848-4ea6-b17b-f4ec9ffd839a service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:08.191527 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af02849-9848-4ea6-b17b-f4ec9ffd839a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:08.198678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:08.200935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af02849-9848-4ea6-b17b-f4ec9ffd839a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:08.202359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af02849-9848-4ea6-b17b-f4ec9ffd839a service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:08.212359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1325/2671] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:08.753446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533a4ba-f697-4614-b7c6-ddee356f1ef2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:08.755266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e533a4ba-f697-4614-b7c6-ddee356f1ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:08.769360 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e533a4ba-f697-4614-b7c6-ddee356f1ef2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:08.774518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:08.775609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:08.776063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:08.776518 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] PATH_INFO: `/v3/projects/badf4c6a4c434cc7bb6feeccf8bd71e4` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:08.778347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] RBAC: Authorizing `identity:delete_project(project_id=badf4c6a4c434cc7bb6feeccf8bd71e4)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:08.780650 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:08.989243 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'badf4c6a4c434cc7bb6feeccf8bd71e4', 'request_id': 'req-6ce2984a-06d6-445e-b218-3496e14a609e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:08.995647 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'badf4c6a4c434cc7bb6feeccf8bd71e4', 'request_id': 'req-6ce2984a-06d6-445e-b218-3496e14a609e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:09.000990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'badf4c6a4c434cc7bb6feeccf8bd71e4', 'request_id': 'req-6ce2984a-06d6-445e-b218-3496e14a609e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:09.103729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] The token cache is being invalidate because project badf4c6a4c434cc7bb6feeccf8bd71e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:09.104423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:09.104717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:09.106319 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1347/2672] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:08 2022] DELETE /identity/v3/projects/badf4c6a4c434cc7bb6feeccf8bd71e4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:09.110304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02849-9848-4ea6-b17b-f4ec9ffd839a service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:09.120795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af02849-9848-4ea6-b17b-f4ec9ffd839a service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:09.177654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:09.179165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:09.179446 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:09.179719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] PATH_INFO: `/v3/users/256b8a5083414610bd34f5b2848dedad` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:09.181126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256b8a5083414610bd34f5b2848dedad)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:09.186063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:09.444345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256b8a5083414610bd34f5b2848dedad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:09.451369 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256b8a5083414610bd34f5b2848dedad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:09.452078 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256b8a5083414610bd34f5b2848dedad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:09.463981 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256b8a5083414610bd34f5b2848dedad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:09.464642 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-4be4c538-547a-44cd-aa99-2cc9e77e03f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256b8a5083414610bd34f5b2848dedad'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:09.585798 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1326/2673] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:09 2022] DELETE /identity/v3/users/256b8a5083414610bd34f5b2848dedad => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:10.060515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:10.060515 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:10.075974 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce2984a-06d6-445e-b218-3496e14a609e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:10.139842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:10.140768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.141048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.141316 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] PATH_INFO: `/v3/projects/62b9b81ffb0b4fa4ae51b66fc6e45743` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:10.144041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62b9b81ffb0b4fa4ae51b66fc6e45743)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:10.145995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:10.168221 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:10.305235 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62b9b81ffb0b4fa4ae51b66fc6e45743', 'request_id': 'req-80f9db68-6517-416d-9022-bee83bdaffa9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:10.312360 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62b9b81ffb0b4fa4ae51b66fc6e45743', 'request_id': 'req-80f9db68-6517-416d-9022-bee83bdaffa9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:10.318796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62b9b81ffb0b4fa4ae51b66fc6e45743', 'request_id': 'req-80f9db68-6517-416d-9022-bee83bdaffa9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:10.386437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] The token cache is being invalidate because project 62b9b81ffb0b4fa4ae51b66fc6e45743 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:10.386820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:10.388092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-80f9db68-6517-416d-9022-bee83bdaffa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:10.389896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1348/2674] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:10 2022] DELETE /identity/v3/projects/62b9b81ffb0b4fa4ae51b66fc6e45743 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:10.395638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4fe41-39c4-4583-9d12-d290cf6191ec None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.397259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4fe41-39c4-4583-9d12-d290cf6191ec None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.397771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a4fe41-39c4-4583-9d12-d290cf6191ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:10.419405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-b4a4fe41-39c4-4583-9d12-d290cf6191ec None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:10.420962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b4a4fe41-39c4-4583-9d12-d290cf6191ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:10.484001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1327/2675] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:44:10.493685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2679e-0bf2-44b0-97d4-3323205a2555 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.493685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2679e-0bf2-44b0-97d4-3323205a2555 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.493685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2679e-0bf2-44b0-97d4-3323205a2555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:10.513879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-e6d2679e-0bf2-44b0-97d4-3323205a2555 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:10.515279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e6d2679e-0bf2-44b0-97d4-3323205a2555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:10.528875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1349/2676] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:10.530126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4fe41-39c4-4583-9d12-d290cf6191ec None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:10.540564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a4fe41-39c4-4583-9d12-d290cf6191ec None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:10.546276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12b61c-39be-4f44-977c-0b024ab4bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:10.547048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b61c-39be-4f44-977c-0b024ab4bb7a admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.547371 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b61c-39be-4f44-977c-0b024ab4bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.548792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c12b61c-39be-4f44-977c-0b024ab4bb7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:10.549905 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12b61c-39be-4f44-977c-0b024ab4bb7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:44:10.550460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12b61c-39be-4f44-977c-0b024ab4bb7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:10.552719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c12b61c-39be-4f44-977c-0b024ab4bb7a admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:10.567980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1328/2677] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:44:10.572180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2679e-0bf2-44b0-97d4-3323205a2555 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:10.581651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2679e-0bf2-44b0-97d4-3323205a2555 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:10.588609 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c12f8-199d-41cd-b9b0-f6d13e0a186c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:10.589589 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c12f8-199d-41cd-b9b0-f6d13e0a186c admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.590068 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c12f8-199d-41cd-b9b0-f6d13e0a186c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.590417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951c12f8-199d-41cd-b9b0-f6d13e0a186c admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:10.591200 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c12f8-199d-41cd-b9b0-f6d13e0a186c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:10.593454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951c12f8-199d-41cd-b9b0-f6d13e0a186c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:10.703883 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1350/2678] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:10 2022] POST /identity/v3/projects => generated 371 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:44:10.705657 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12b61c-39be-4f44-977c-0b024ab4bb7a admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:10.710924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:10.716261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c12b61c-39be-4f44-977c-0b024ab4bb7a admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:10.774831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51916683-8fbf-4ed1-9f1a-39749fa97574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:10.775310 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51916683-8fbf-4ed1-9f1a-39749fa97574 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.775591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51916683-8fbf-4ed1-9f1a-39749fa97574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.775852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51916683-8fbf-4ed1-9f1a-39749fa97574 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:10.776595 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51916683-8fbf-4ed1-9f1a-39749fa97574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:10.778576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51916683-8fbf-4ed1-9f1a-39749fa97574 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:10.864644 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c12f8-199d-41cd-b9b0-f6d13e0a186c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:10.866634 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-951c12f8-199d-41cd-b9b0-f6d13e0a186c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:10.879534 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951c12f8-199d-41cd-b9b0-f6d13e0a186c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:10.884124 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:10.885027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.885304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.885755 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] PATH_INFO: `/v3/users/3458b45d4fc74c1cbf6483b4d6211619` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:10.886957 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3458b45d4fc74c1cbf6483b4d6211619)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:10.888911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:10.904335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1329/2679] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:10 2022] POST /identity/v3/users => generated 286 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:10.909478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51916683-8fbf-4ed1-9f1a-39749fa97574 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:10.920033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51916683-8fbf-4ed1-9f1a-39749fa97574 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:10.925346 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dfa08-4644-4a6b-ba78-a7dbd199fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:10.925999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dfa08-4644-4a6b-ba78-a7dbd199fcad admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.926283 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dfa08-4644-4a6b-ba78-a7dbd199fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.926560 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881dfa08-4644-4a6b-ba78-a7dbd199fcad admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:10.927281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dfa08-4644-4a6b-ba78-a7dbd199fcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:10.928934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881dfa08-4644-4a6b-ba78-a7dbd199fcad admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:10.939623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1330/2680] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:44:10.943477 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dfa08-4644-4a6b-ba78-a7dbd199fcad admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:10.952745 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881dfa08-4644-4a6b-ba78-a7dbd199fcad admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:10.957599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08cf1a-d1a4-48ee-889e-0cdfd5f9010b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:10.958276 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08cf1a-d1a4-48ee-889e-0cdfd5f9010b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.958556 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08cf1a-d1a4-48ee-889e-0cdfd5f9010b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.958858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d08cf1a-d1a4-48ee-889e-0cdfd5f9010b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:10.959579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08cf1a-d1a4-48ee-889e-0cdfd5f9010b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:10.961174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d08cf1a-d1a4-48ee-889e-0cdfd5f9010b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:10.971461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1331/2681] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:44:10.975087 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08cf1a-d1a4-48ee-889e-0cdfd5f9010b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:10.984665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d08cf1a-d1a4-48ee-889e-0cdfd5f9010b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:10.990409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7753ec-7247-4f72-984d-5912315f4652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:10.991304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7753ec-7247-4f72-984d-5912315f4652 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:10.991584 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7753ec-7247-4f72-984d-5912315f4652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:10.991858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7753ec-7247-4f72-984d-5912315f4652 admin admin] PATH_INFO: `/v3/projects/ae112ac32fc240929a6687cb330f95c9/users/b86917d4d6284a71ae479899337fcb32/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:11.008640 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7753ec-7247-4f72-984d-5912315f4652 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae112ac32fc240929a6687cb330f95c9, user_id=b86917d4d6284a71ae479899337fcb32, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:11.011347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7753ec-7247-4f72-984d-5912315f4652 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:11.094611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1332/2682] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:10 2022] PUT /identity/v3/projects/ae112ac32fc240929a6687cb330f95c9/users/b86917d4d6284a71ae479899337fcb32/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:44:11.106971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fbe56-aca6-4f2a-b4ae-ab051a547507 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:11.107261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fbe56-aca6-4f2a-b4ae-ab051a547507 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:11.107538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728fbe56-aca6-4f2a-b4ae-ab051a547507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:11.115346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3458b45d4fc74c1cbf6483b4d6211619'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:11.131574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3458b45d4fc74c1cbf6483b4d6211619'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:11.159058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-728fbe56-aca6-4f2a-b4ae-ab051a547507 None None] MFA Rules not processed for user `b86917d4d6284a71ae479899337fcb32`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:11.160959 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-728fbe56-aca6-4f2a-b4ae-ab051a547507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:11.178362 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3458b45d4fc74c1cbf6483b4d6211619'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:11.179372 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3458b45d4fc74c1cbf6483b4d6211619'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:11.180691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-1cb58c03-172e-4b25-892e-532ec4f84a7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3458b45d4fc74c1cbf6483b4d6211619'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:11.199409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1351/2683] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:10 2022] DELETE /identity/v3/users/3458b45d4fc74c1cbf6483b4d6211619 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:44:11.203972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae70d-ac86-474a-9b5f-db034e6b406e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:11.204285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae70d-ac86-474a-9b5f-db034e6b406e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:11.205175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ae70d-ac86-474a-9b5f-db034e6b406e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:11.224591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-918ae70d-ac86-474a-9b5f-db034e6b406e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:11.226011 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-918ae70d-ac86-474a-9b5f-db034e6b406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:11.237674 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1333/2684] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:44:11.260533 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fbe56-aca6-4f2a-b4ae-ab051a547507 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:11.263250 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-728fbe56-aca6-4f2a-b4ae-ab051a547507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:11.283135 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:11.308620 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1352/2685] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:11.318108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae70d-ac86-474a-9b5f-db034e6b406e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:11.323678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-918ae70d-ac86-474a-9b5f-db034e6b406e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:11.323829 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:11.340904 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728fbe56-aca6-4f2a-b4ae-ab051a547507 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:11.386368 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ae70d-ac86-474a-9b5f-db034e6b406e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:11.390665 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cdab6-66e4-4840-8678-be8ab0c9b40e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:11.391417 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cdab6-66e4-4840-8678-be8ab0c9b40e service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:11.391697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cdab6-66e4-4840-8678-be8ab0c9b40e service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:11.392715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08cdab6-66e4-4840-8678-be8ab0c9b40e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:11.397546 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c617edf-d17d-43db-8066-bdf2ffe7a508 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451754f5553e4b9783b4e75f6d408ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:11.398198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617edf-d17d-43db-8066-bdf2ffe7a508 service glance] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:11.398486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617edf-d17d-43db-8066-bdf2ffe7a508 service glance] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:11.398761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c617edf-d17d-43db-8066-bdf2ffe7a508 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:11.402684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cdab6-66e4-4840-8678-be8ab0c9b40e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:11.404126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08cdab6-66e4-4840-8678-be8ab0c9b40e service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:11.415933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1353/2686] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:11.463003 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c617edf-d17d-43db-8066-bdf2ffe7a508 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:11.464962 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c617edf-d17d-43db-8066-bdf2ffe7a508 service glance] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:11.477058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1334/2687] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:11.934361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cdab6-66e4-4840-8678-be8ab0c9b40e service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:11.936364 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c08cdab6-66e4-4840-8678-be8ab0c9b40e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:11.969813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08cdab6-66e4-4840-8678-be8ab0c9b40e service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:11.975573 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:11.976504 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:11.976807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:11.977081 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] PATH_INFO: `/v3/projects/8777d5e80dd740fc9e6ef0d528f26884` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:11.978264 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8777d5e80dd740fc9e6ef0d528f26884)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:11.980180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:12.127172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8777d5e80dd740fc9e6ef0d528f26884', 'request_id': 'req-c239873c-006e-4232-80fe-410cdc71e2b2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:12.133711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8777d5e80dd740fc9e6ef0d528f26884', 'request_id': 'req-c239873c-006e-4232-80fe-410cdc71e2b2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:12.139265 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8777d5e80dd740fc9e6ef0d528f26884', 'request_id': 'req-c239873c-006e-4232-80fe-410cdc71e2b2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:12.282375 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] The token cache is being invalidate because project 8777d5e80dd740fc9e6ef0d528f26884 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:12.284240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:12.284932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c239873c-006e-4232-80fe-410cdc71e2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:12.287148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1354/2688] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:11 2022] DELETE /identity/v3/projects/8777d5e80dd740fc9e6ef0d528f26884 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:12.292123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada761ce-3ce4-4e5b-97cb-48c1e9847a25 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:12.292505 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada761ce-3ce4-4e5b-97cb-48c1e9847a25 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:12.292857 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada761ce-3ce4-4e5b-97cb-48c1e9847a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:12.311731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-ada761ce-3ce4-4e5b-97cb-48c1e9847a25 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:12.312963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-ada761ce-3ce4-4e5b-97cb-48c1e9847a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:12.394353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1335/2689] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:12.395704 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee9063-9352-4c68-a978-a678b630c123 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:12.395998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee9063-9352-4c68-a978-a678b630c123 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:12.396282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ee9063-9352-4c68-a978-a678b630c123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:12.435865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-46ee9063-9352-4c68-a978-a678b630c123 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:12.436657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-46ee9063-9352-4c68-a978-a678b630c123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:12.446266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1355/2690] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:44:12.450621 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada761ce-3ce4-4e5b-97cb-48c1e9847a25 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:12.461376 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada761ce-3ce4-4e5b-97cb-48c1e9847a25 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:12.467777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10849d9-4e98-46f9-ac64-b5725b1c5405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:12.468443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10849d9-4e98-46f9-ac64-b5725b1c5405 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:12.468755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10849d9-4e98-46f9-ac64-b5725b1c5405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:12.470382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10849d9-4e98-46f9-ac64-b5725b1c5405 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:12.470382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10849d9-4e98-46f9-ac64-b5725b1c5405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:44:12.470382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10849d9-4e98-46f9-ac64-b5725b1c5405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:12.471983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10849d9-4e98-46f9-ac64-b5725b1c5405 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:12.485841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1336/2691] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:44:12.490876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee9063-9352-4c68-a978-a678b630c123 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:12.500884 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ee9063-9352-4c68-a978-a678b630c123 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:12.509422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211061f-8375-4c3a-9d20-8884f46af0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:12.510464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211061f-8375-4c3a-9d20-8884f46af0eb admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:12.510591 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211061f-8375-4c3a-9d20-8884f46af0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:12.511015 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7211061f-8375-4c3a-9d20-8884f46af0eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:12.511645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211061f-8375-4c3a-9d20-8884f46af0eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:12.514606 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7211061f-8375-4c3a-9d20-8884f46af0eb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:12.603830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1356/2692] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:12 2022] POST /identity/v3/projects => generated 375 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:12.607845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10849d9-4e98-46f9-ac64-b5725b1c5405 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:12.619481 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10849d9-4e98-46f9-ac64-b5725b1c5405 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:12.655355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:12.682699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6338-d558-47fb-9a17-49294f65938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:12.683473 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6338-d558-47fb-9a17-49294f65938e admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:12.683949 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6338-d558-47fb-9a17-49294f65938e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:12.684230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a6338-d558-47fb-9a17-49294f65938e admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:12.684966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a6338-d558-47fb-9a17-49294f65938e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:12.686871 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a6338-d558-47fb-9a17-49294f65938e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:12.774565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1337/2693] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:12 2022] POST /identity/v3/users => generated 288 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:12.777047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211061f-8375-4c3a-9d20-8884f46af0eb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:12.788071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7211061f-8375-4c3a-9d20-8884f46af0eb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:12.792955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe3983-276e-46f6-97fb-f27fbd45fe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:12.793628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe3983-276e-46f6-97fb-f27fbd45fe27 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:12.793915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe3983-276e-46f6-97fb-f27fbd45fe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:12.794193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fe3983-276e-46f6-97fb-f27fbd45fe27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:12.794933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe3983-276e-46f6-97fb-f27fbd45fe27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:12.796563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fe3983-276e-46f6-97fb-f27fbd45fe27 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:12.810373 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1357/2694] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:12.813835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6338-d558-47fb-9a17-49294f65938e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:12.826320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a6338-d558-47fb-9a17-49294f65938e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:12.831366 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec838c-5a06-4628-962a-4489a68c9e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:12.832143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec838c-5a06-4628-962a-4489a68c9e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:12.832552 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec838c-5a06-4628-962a-4489a68c9e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:12.832933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec838c-5a06-4628-962a-4489a68c9e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:12.833780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec838c-5a06-4628-962a-4489a68c9e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:12.835813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec838c-5a06-4628-962a-4489a68c9e3b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:12.847404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1338/2695] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:12.855396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe3983-276e-46f6-97fb-f27fbd45fe27 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:12.867911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fe3983-276e-46f6-97fb-f27fbd45fe27 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:12.873695 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2260ee-f916-49e4-9ce1-8e43a0c0e51a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:12.874722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2260ee-f916-49e4-9ce1-8e43a0c0e51a admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:12.875007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2260ee-f916-49e4-9ce1-8e43a0c0e51a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:12.875284 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2260ee-f916-49e4-9ce1-8e43a0c0e51a admin admin] PATH_INFO: `/v3/projects/281052e24b3d423ea256ce0cc993592a/users/d97c1ac0a4f849c4bb308efbd4f0de2e/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:12.897556 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2260ee-f916-49e4-9ce1-8e43a0c0e51a admin admin] RBAC: Authorizing `identity:create_grant(project_id=281052e24b3d423ea256ce0cc993592a, user_id=d97c1ac0a4f849c4bb308efbd4f0de2e, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:12.900626 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2260ee-f916-49e4-9ce1-8e43a0c0e51a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:12.977923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1358/2696] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:12 2022] PUT /identity/v3/projects/281052e24b3d423ea256ce0cc993592a/users/d97c1ac0a4f849c4bb308efbd4f0de2e/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:12.989393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31541fb7-23fa-4e0c-a4d2-9d6ab728644c None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:12.989611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31541fb7-23fa-4e0c-a4d2-9d6ab728644c None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:12.990200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31541fb7-23fa-4e0c-a4d2-9d6ab728644c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:13.019658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-31541fb7-23fa-4e0c-a4d2-9d6ab728644c None None] MFA Rules not processed for user `d97c1ac0a4f849c4bb308efbd4f0de2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:13.021062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-31541fb7-23fa-4e0c-a4d2-9d6ab728644c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:13.094363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1339/2697] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:13.100872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2260ee-f916-49e4-9ce1-8e43a0c0e51a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:13.121452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:13.177111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2260ee-f916-49e4-9ce1-8e43a0c0e51a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:13.182697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d293cb4-d3e1-4aed-944d-0642592f4ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:13.184356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d293cb4-d3e1-4aed-944d-0642592f4ac5 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:13.184356 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d293cb4-d3e1-4aed-944d-0642592f4ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:13.184711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d293cb4-d3e1-4aed-944d-0642592f4ac5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:13.185399 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d293cb4-d3e1-4aed-944d-0642592f4ac5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:13.187395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d293cb4-d3e1-4aed-944d-0642592f4ac5 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:13.294067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1359/2698] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:13 2022] POST /identity/v3/projects => generated 375 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:13.298229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31541fb7-23fa-4e0c-a4d2-9d6ab728644c None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:13.309117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31541fb7-23fa-4e0c-a4d2-9d6ab728644c None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:13.366893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825c545-dea4-4f6c-b033-023a8244dd68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:13.367559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825c545-dea4-4f6c-b033-023a8244dd68 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:13.367850 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825c545-dea4-4f6c-b033-023a8244dd68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:13.368128 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825c545-dea4-4f6c-b033-023a8244dd68 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:13.368848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825c545-dea4-4f6c-b033-023a8244dd68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:13.370777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2825c545-dea4-4f6c-b033-023a8244dd68 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:13.470069 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1340/2699] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:13 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:13.474327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d293cb4-d3e1-4aed-944d-0642592f4ac5 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:13.485108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d293cb4-d3e1-4aed-944d-0642592f4ac5 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:13.490824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d671de1-5446-4775-be78-c8d1ed62ff88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:13.491516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d671de1-5446-4775-be78-c8d1ed62ff88 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:13.491791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d671de1-5446-4775-be78-c8d1ed62ff88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:13.492066 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d671de1-5446-4775-be78-c8d1ed62ff88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:13.492835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d671de1-5446-4775-be78-c8d1ed62ff88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:13.494436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d671de1-5446-4775-be78-c8d1ed62ff88 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:13.506966 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1360/2700] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:13.511208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825c545-dea4-4f6c-b033-023a8244dd68 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:13.521635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825c545-dea4-4f6c-b033-023a8244dd68 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:13.526379 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eb3f5-6b5b-4711-a8c6-8c6f46ec8596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:13.527229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eb3f5-6b5b-4711-a8c6-8c6f46ec8596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:13.527510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eb3f5-6b5b-4711-a8c6-8c6f46ec8596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:13.527783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eb3f5-6b5b-4711-a8c6-8c6f46ec8596 admin admin] PATH_INFO: `/v3/projects/e3579de84fde4a82b6df83583144e662/users/cc9c36edda524d56bacb15aacb74e7c5/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:13.544030 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eb3f5-6b5b-4711-a8c6-8c6f46ec8596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3579de84fde4a82b6df83583144e662, user_id=cc9c36edda524d56bacb15aacb74e7c5, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:13.546768 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eb3f5-6b5b-4711-a8c6-8c6f46ec8596 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:13.635864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1341/2701] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:13 2022] PUT /identity/v3/projects/e3579de84fde4a82b6df83583144e662/users/cc9c36edda524d56bacb15aacb74e7c5/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:44:13.640175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d671de1-5446-4775-be78-c8d1ed62ff88 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:13.650979 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d671de1-5446-4775-be78-c8d1ed62ff88 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:13.728167 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033c1883-c34e-4959-a086-2d6ce14a74e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:13.728894 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c1883-c34e-4959-a086-2d6ce14a74e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:13.729173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c1883-c34e-4959-a086-2d6ce14a74e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:13.729471 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033c1883-c34e-4959-a086-2d6ce14a74e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:13.731160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c1883-c34e-4959-a086-2d6ce14a74e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:13.732830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033c1883-c34e-4959-a086-2d6ce14a74e0 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:13.759205 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1361/2702] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:13.763679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eb3f5-6b5b-4711-a8c6-8c6f46ec8596 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:13.776521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eb3f5-6b5b-4711-a8c6-8c6f46ec8596 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:13.782738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b9823-1a8e-4e07-a416-87b4fe506b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:13.784195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b9823-1a8e-4e07-a416-87b4fe506b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:13.784587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b9823-1a8e-4e07-a416-87b4fe506b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:13.784923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1b9823-1a8e-4e07-a416-87b4fe506b6b admin admin] PATH_INFO: `/v3/projects/e3579de84fde4a82b6df83583144e662/users/cc9c36edda524d56bacb15aacb74e7c5/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:13.787292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b9823-1a8e-4e07-a416-87b4fe506b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3579de84fde4a82b6df83583144e662, user_id=cc9c36edda524d56bacb15aacb74e7c5, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:13.790113 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1b9823-1a8e-4e07-a416-87b4fe506b6b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:13.792621 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:13.802558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1342/2703] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:13 2022] PUT /identity/v3/projects/e3579de84fde4a82b6df83583144e662/users/cc9c36edda524d56bacb15aacb74e7c5/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:13.813593 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d6977-6fb9-459c-952b-a1448b555b5f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:13.814431 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d6977-6fb9-459c-952b-a1448b555b5f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:13.814880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d6977-6fb9-459c-952b-a1448b555b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:13.846274 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-044d6977-6fb9-459c-952b-a1448b555b5f None None] MFA Rules not processed for user `cc9c36edda524d56bacb15aacb74e7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:13.848416 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-044d6977-6fb9-459c-952b-a1448b555b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:13.923212 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1362/2704] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:13 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:13.936121 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b9823-1a8e-4e07-a416-87b4fe506b6b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:13.938613 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-0c1b9823-1a8e-4e07-a416-87b4fe506b6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:14.000160 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1b9823-1a8e-4e07-a416-87b4fe506b6b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:14.004314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88130328-d93a-4788-a32e-2770c199d69e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:14.004986 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88130328-d93a-4788-a32e-2770c199d69e service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:14.005269 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88130328-d93a-4788-a32e-2770c199d69e service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:14.005539 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88130328-d93a-4788-a32e-2770c199d69e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:14.066699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88130328-d93a-4788-a32e-2770c199d69e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:14.066699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88130328-d93a-4788-a32e-2770c199d69e service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:14.075826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1343/2705] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:21.395491 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d6977-6fb9-459c-952b-a1448b555b5f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:21.405845 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:21.460748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d6977-6fb9-459c-952b-a1448b555b5f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:21.465249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:21.466145 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:21.466420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:21.466715 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] PATH_INFO: `/v3/users/d97c1ac0a4f849c4bb308efbd4f0de2e` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:21.467859 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d97c1ac0a4f849c4bb308efbd4f0de2e)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:21.469822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:21.695023 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd97c1ac0a4f849c4bb308efbd4f0de2e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:21.707380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd97c1ac0a4f849c4bb308efbd4f0de2e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:21.784682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd97c1ac0a4f849c4bb308efbd4f0de2e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:21.785322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd97c1ac0a4f849c4bb308efbd4f0de2e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:21.786072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd97c1ac0a4f849c4bb308efbd4f0de2e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:21.800251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1363/2706] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:21 2022] DELETE /identity/v3/users/d97c1ac0a4f849c4bb308efbd4f0de2e => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:21.805639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f076f27-292f-441c-ac13-4003d8c7d6ad None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:21.806166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f076f27-292f-441c-ac13-4003d8c7d6ad None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:21.806166 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f076f27-292f-441c-ac13-4003d8c7d6ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:21.827467 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-7f076f27-292f-441c-ac13-4003d8c7d6ad None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:21.828782 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7f076f27-292f-441c-ac13-4003d8c7d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:21.890171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1344/2707] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:21.900073 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:21.901538 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:21.967292 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b6c5c2-2328-41f9-b816-0d2b856ec46a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:21.970796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091f629-4bd1-4155-a7e1-02711453d1bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:21.971441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091f629-4bd1-4155-a7e1-02711453d1bb service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:21.971727 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091f629-4bd1-4155-a7e1-02711453d1bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:21.972004 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4091f629-4bd1-4155-a7e1-02711453d1bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:21.981908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091f629-4bd1-4155-a7e1-02711453d1bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:21.983369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4091f629-4bd1-4155-a7e1-02711453d1bb service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:21.993427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1364/2708] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:22.593518 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f076f27-292f-441c-ac13-4003d8c7d6ad None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:22.593714 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7f076f27-292f-441c-ac13-4003d8c7d6ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:22.607840 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f076f27-292f-441c-ac13-4003d8c7d6ad None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:22.612680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:22.613551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:22.613831 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:22.614105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] PATH_INFO: `/v3/projects/281052e24b3d423ea256ce0cc993592a` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:22.615731 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=281052e24b3d423ea256ce0cc993592a)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:22.617701 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:22.747171 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:22.750937 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '281052e24b3d423ea256ce0cc993592a', 'request_id': 'req-1cd62f1e-822c-41c0-89bb-e8c60d185255'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:22.757932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '281052e24b3d423ea256ce0cc993592a', 'request_id': 'req-1cd62f1e-822c-41c0-89bb-e8c60d185255'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:22.763516 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '281052e24b3d423ea256ce0cc993592a', 'request_id': 'req-1cd62f1e-822c-41c0-89bb-e8c60d185255'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:22.903635 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] The token cache is being invalidate because project 281052e24b3d423ea256ce0cc993592a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:22.904337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:22.904549 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:22.906167 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1345/2709] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:22 2022] DELETE /identity/v3/projects/281052e24b3d423ea256ce0cc993592a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:22.910236 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091f629-4bd1-4155-a7e1-02711453d1bb service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:22.919880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4091f629-4bd1-4155-a7e1-02711453d1bb service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:22.949918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:22.986189 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:22.987069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:22.987346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:22.987624 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] PATH_INFO: `/v3/users/cc9c36edda524d56bacb15aacb74e7c5` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:22.988828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc9c36edda524d56bacb15aacb74e7c5)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:22.991740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:23.221931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc9c36edda524d56bacb15aacb74e7c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:23.234615 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc9c36edda524d56bacb15aacb74e7c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:23.355185 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc9c36edda524d56bacb15aacb74e7c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:23.355808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc9c36edda524d56bacb15aacb74e7c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:23.356420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-5974a132-9a66-44e7-98fd-f83d7fc1649a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc9c36edda524d56bacb15aacb74e7c5'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:23.369962 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1365/2710] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:22 2022] DELETE /identity/v3/users/cc9c36edda524d56bacb15aacb74e7c5 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:23.900316 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:23.902089 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:23.917854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd62f1e-822c-41c0-89bb-e8c60d185255 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:23.984393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:23.985296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:23.985641 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:23.985852 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] PATH_INFO: `/v3/projects/e3579de84fde4a82b6df83583144e662` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:23.987165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3579de84fde4a82b6df83583144e662)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:23.989088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:24.133884 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3579de84fde4a82b6df83583144e662', 'request_id': 'req-21c9d312-a810-423a-be32-363931e0eda6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:24.140291 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3579de84fde4a82b6df83583144e662', 'request_id': 'req-21c9d312-a810-423a-be32-363931e0eda6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:24.146032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3579de84fde4a82b6df83583144e662', 'request_id': 'req-21c9d312-a810-423a-be32-363931e0eda6'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:24.247305 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] The token cache is being invalidate because project e3579de84fde4a82b6df83583144e662 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:24.247591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:24.248198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-21c9d312-a810-423a-be32-363931e0eda6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:24.249833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1346/2711] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:23 2022] DELETE /identity/v3/projects/e3579de84fde4a82b6df83583144e662 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:24.256788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4885486-4505-4055-bbae-aa90ea4db7b2 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:24.256788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4885486-4505-4055-bbae-aa90ea4db7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:24.256788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4885486-4505-4055-bbae-aa90ea4db7b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:24.277304 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f4885486-4505-4055-bbae-aa90ea4db7b2 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:24.278523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f4885486-4505-4055-bbae-aa90ea4db7b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:24.341494 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1366/2712] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:24.350427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85b18-4cee-444f-8d01-69641df2143a None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:24.350719 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85b18-4cee-444f-8d01-69641df2143a None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:24.351001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc85b18-4cee-444f-8d01-69641df2143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:24.371679 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-bdc85b18-4cee-444f-8d01-69641df2143a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:24.373816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-bdc85b18-4cee-444f-8d01-69641df2143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:24.383196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1347/2713] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:24.387760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4885486-4505-4055-bbae-aa90ea4db7b2 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:24.397887 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4885486-4505-4055-bbae-aa90ea4db7b2 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:24.402694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891c791-02c9-400e-adcd-976a5d8f7dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:24.403348 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891c791-02c9-400e-adcd-976a5d8f7dcb admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:24.403635 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891c791-02c9-400e-adcd-976a5d8f7dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:24.403912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891c791-02c9-400e-adcd-976a5d8f7dcb admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:24.404870 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891c791-02c9-400e-adcd-976a5d8f7dcb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:44:24.405177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891c791-02c9-400e-adcd-976a5d8f7dcb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:24.406813 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d891c791-02c9-400e-adcd-976a5d8f7dcb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:24.421049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1367/2714] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:44:24.426485 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85b18-4cee-444f-8d01-69641df2143a None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:24.437452 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc85b18-4cee-444f-8d01-69641df2143a None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:24.442521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ad430-996f-4cbf-8ece-a1e20f32691b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:24.443156 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ad430-996f-4cbf-8ece-a1e20f32691b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:24.443545 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ad430-996f-4cbf-8ece-a1e20f32691b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:24.443826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2ad430-996f-4cbf-8ece-a1e20f32691b admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:24.444628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ad430-996f-4cbf-8ece-a1e20f32691b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:24.446580 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2ad430-996f-4cbf-8ece-a1e20f32691b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:24.587930 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1348/2715] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:24 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:24.590671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891c791-02c9-400e-adcd-976a5d8f7dcb admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:24.604193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891c791-02c9-400e-adcd-976a5d8f7dcb admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:24.640237 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:24.663656 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f3c25-b6b9-4cff-88d0-5126fc0dde1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:24.664347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f3c25-b6b9-4cff-88d0-5126fc0dde1b admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:24.664785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f3c25-b6b9-4cff-88d0-5126fc0dde1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:24.665068 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f3c25-b6b9-4cff-88d0-5126fc0dde1b admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:24.665780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f3c25-b6b9-4cff-88d0-5126fc0dde1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:24.667760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f3c25-b6b9-4cff-88d0-5126fc0dde1b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:24.726728 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1368/2716] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:24 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:24.730983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ad430-996f-4cbf-8ece-a1e20f32691b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:24.741685 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2ad430-996f-4cbf-8ece-a1e20f32691b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:24.746644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223e737-8051-457e-b774-6c497be8926d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:24.748471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223e737-8051-457e-b774-6c497be8926d admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:24.748471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223e737-8051-457e-b774-6c497be8926d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:24.748471 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0223e737-8051-457e-b774-6c497be8926d admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:24.748832 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223e737-8051-457e-b774-6c497be8926d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:24.750364 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0223e737-8051-457e-b774-6c497be8926d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:24.767004 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1349/2717] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:24.771095 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f3c25-b6b9-4cff-88d0-5126fc0dde1b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:24.781590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f3c25-b6b9-4cff-88d0-5126fc0dde1b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:24.786225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7385e2d-20d0-4af1-8484-20d41bfa9c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:24.786879 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385e2d-20d0-4af1-8484-20d41bfa9c79 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:24.787309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385e2d-20d0-4af1-8484-20d41bfa9c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:24.787712 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7385e2d-20d0-4af1-8484-20d41bfa9c79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:24.788358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7385e2d-20d0-4af1-8484-20d41bfa9c79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:24.789995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7385e2d-20d0-4af1-8484-20d41bfa9c79 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:24.800818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1369/2718] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:24.805318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223e737-8051-457e-b774-6c497be8926d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:24.815309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0223e737-8051-457e-b774-6c497be8926d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:24.821174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7d349-ec94-4876-b94f-6225e1348bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:24.822123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7d349-ec94-4876-b94f-6225e1348bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:24.822415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7d349-ec94-4876-b94f-6225e1348bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:24.822704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d7d349-ec94-4876-b94f-6225e1348bfb admin admin] PATH_INFO: `/v3/projects/503b7b22507f4ac0955d760fdc69525c/users/a337a6fce4f14771a7f9b176042af7f6/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:24.839119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7d349-ec94-4876-b94f-6225e1348bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=503b7b22507f4ac0955d760fdc69525c, user_id=a337a6fce4f14771a7f9b176042af7f6, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:24.841802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d7d349-ec94-4876-b94f-6225e1348bfb admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:24.932837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:24.938755 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1350/2719] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:24 2022] PUT /identity/v3/projects/503b7b22507f4ac0955d760fdc69525c/users/a337a6fce4f14771a7f9b176042af7f6/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:44:24.950627 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33306ac3-c298-4685-9f31-c76e99bb0e9f None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:24.950912 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33306ac3-c298-4685-9f31-c76e99bb0e9f None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:24.951195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33306ac3-c298-4685-9f31-c76e99bb0e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:24.977921 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-33306ac3-c298-4685-9f31-c76e99bb0e9f None None] MFA Rules not processed for user `a337a6fce4f14771a7f9b176042af7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:24.979109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-33306ac3-c298-4685-9f31-c76e99bb0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:25.047039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1370/2720] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:25.058451 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7d349-ec94-4876-b94f-6225e1348bfb admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:25.060229 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-11d7d349-ec94-4876-b94f-6225e1348bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:25.123265 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d7d349-ec94-4876-b94f-6225e1348bfb admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:25.127314 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c29102-614e-4e54-896a-3d484638644b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:25.127971 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c29102-614e-4e54-896a-3d484638644b service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:25.128258 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c29102-614e-4e54-896a-3d484638644b service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:25.128591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c29102-614e-4e54-896a-3d484638644b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:25.138358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c29102-614e-4e54-896a-3d484638644b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:25.139779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c29102-614e-4e54-896a-3d484638644b service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:25.149520 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1351/2721] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:25 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:35.051936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:35.145348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=27 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:35.783773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33306ac3-c298-4685-9f31-c76e99bb0e9f None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:35.783773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-33306ac3-c298-4685-9f31-c76e99bb0e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:35.884523 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33306ac3-c298-4685-9f31-c76e99bb0e9f None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:35.890286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351701a-087d-4e1c-8bc4-01ccc8570cc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:35.890992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351701a-087d-4e1c-8bc4-01ccc8570cc9 service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:35.891279 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351701a-087d-4e1c-8bc4-01ccc8570cc9 service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:35.891560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5351701a-087d-4e1c-8bc4-01ccc8570cc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:35.894036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5351701a-087d-4e1c-8bc4-01ccc8570cc9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:35.920234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351701a-087d-4e1c-8bc4-01ccc8570cc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:35.922253 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5351701a-087d-4e1c-8bc4-01ccc8570cc9 service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:35.939063 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1371/2722] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:37.515710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c29102-614e-4e54-896a-3d484638644b service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:37.517318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-53c29102-614e-4e54-896a-3d484638644b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:37.533368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c29102-614e-4e54-896a-3d484638644b service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:37.539478 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1ab383-7a66-41a8-a824-de75b08548d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:37.540114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ab383-7a66-41a8-a824-de75b08548d4 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:37.540398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ab383-7a66-41a8-a824-de75b08548d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:37.540700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1ab383-7a66-41a8-a824-de75b08548d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:37.542457 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5f1ab383-7a66-41a8-a824-de75b08548d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:37.602622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ab383-7a66-41a8-a824-de75b08548d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:37.604220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1ab383-7a66-41a8-a824-de75b08548d4 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:37.613384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1352/2723] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:38.435805 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351701a-087d-4e1c-8bc4-01ccc8570cc9 service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:38.505699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5351701a-087d-4e1c-8bc4-01ccc8570cc9 service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:38.511282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:38.512163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:38.512447 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:38.512815 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] PATH_INFO: `/v3/users/a337a6fce4f14771a7f9b176042af7f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:38.514049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a337a6fce4f14771a7f9b176042af7f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:38.516100 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:38.758875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a337a6fce4f14771a7f9b176042af7f6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:38.771041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a337a6fce4f14771a7f9b176042af7f6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:38.851420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a337a6fce4f14771a7f9b176042af7f6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:38.851420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a337a6fce4f14771a7f9b176042af7f6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:38.851420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a337a6fce4f14771a7f9b176042af7f6'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:38.862806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1372/2724] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:38 2022] DELETE /identity/v3/users/a337a6fce4f14771a7f9b176042af7f6 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:38.868606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cd5eb-6fd4-4f36-87ea-143900496839 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:38.873744 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cd5eb-6fd4-4f36-87ea-143900496839 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:38.873744 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cd5eb-6fd4-4f36-87ea-143900496839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:38.889991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-032cd5eb-6fd4-4f36-87ea-143900496839 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:38.891466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-032cd5eb-6fd4-4f36-87ea-143900496839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:38.965058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1353/2725] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:44:38.981541 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:38.983155 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:38.992084 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:39.055873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97a372-88e0-43e5-991c-5ba7a694c614 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:39.065378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5e233-a7cf-457d-9dd4-479c7d405c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:39.065378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5e233-a7cf-457d-9dd4-479c7d405c0d service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:39.065378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5e233-a7cf-457d-9dd4-479c7d405c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:39.065378 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5e233-a7cf-457d-9dd4-479c7d405c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:39.070454 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5e233-a7cf-457d-9dd4-479c7d405c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:39.071900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5e233-a7cf-457d-9dd4-479c7d405c0d service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:39.081804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1373/2726] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:44:39.539764 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cd5eb-6fd4-4f36-87ea-143900496839 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:39.545065 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-032cd5eb-6fd4-4f36-87ea-143900496839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:39.554073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cd5eb-6fd4-4f36-87ea-143900496839 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:39.558825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:39.559754 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:39.560035 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:39.560322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] PATH_INFO: `/v3/projects/503b7b22507f4ac0955d760fdc69525c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:39.561576 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=503b7b22507f4ac0955d760fdc69525c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:39.563480 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:39.687374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '503b7b22507f4ac0955d760fdc69525c', 'request_id': 'req-30c76c75-0dfd-4616-a7fe-f8912fa09a62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:39.695678 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '503b7b22507f4ac0955d760fdc69525c', 'request_id': 'req-30c76c75-0dfd-4616-a7fe-f8912fa09a62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:39.702823 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '503b7b22507f4ac0955d760fdc69525c', 'request_id': 'req-30c76c75-0dfd-4616-a7fe-f8912fa09a62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:39.845863 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] The token cache is being invalidate because project 503b7b22507f4ac0955d760fdc69525c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:39.846152 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:39.847178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:39.848795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1354/2727] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:39 2022] DELETE /identity/v3/projects/503b7b22507f4ac0955d760fdc69525c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:44:40.418797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5e233-a7cf-457d-9dd4-479c7d405c0d service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:40.418797 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-89e5e233-a7cf-457d-9dd4-479c7d405c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:40.491383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5e233-a7cf-457d-9dd4-479c7d405c0d service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:40.551477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5686ee-4076-46b0-b5e8-ab424efcfee7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:40.552133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5686ee-4076-46b0-b5e8-ab424efcfee7 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:40.552420 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5686ee-4076-46b0-b5e8-ab424efcfee7 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:40.553424 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5686ee-4076-46b0-b5e8-ab424efcfee7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:40.555338 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-4c5686ee-4076-46b0-b5e8-ab424efcfee7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:40.567161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5686ee-4076-46b0-b5e8-ab424efcfee7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:40.568920 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5686ee-4076-46b0-b5e8-ab424efcfee7 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:40.580468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1374/2728] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:41.405788 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:41.407198 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:41.436564 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:41.514789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c76c75-0dfd-4616-a7fe-f8912fa09a62 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:41.519688 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:41.520704 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:41.521053 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:41.521397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] PATH_INFO: `/v3/users/3ecb1b1557474a7a9647760b23c51358` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:41.522762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecb1b1557474a7a9647760b23c51358)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:41.524793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:41.735923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecb1b1557474a7a9647760b23c51358'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:41.745964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecb1b1557474a7a9647760b23c51358'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:41.746800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecb1b1557474a7a9647760b23c51358'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:41.763598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecb1b1557474a7a9647760b23c51358'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:41.764413 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecb1b1557474a7a9647760b23c51358'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:41.875189 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1355/2729] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:41 2022] DELETE /identity/v3/users/3ecb1b1557474a7a9647760b23c51358 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:41.879972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23787721-6421-43a0-b0e5-4cdb83efd91d None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:41.880596 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23787721-6421-43a0-b0e5-4cdb83efd91d None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:41.880775 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23787721-6421-43a0-b0e5-4cdb83efd91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:41.899037 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-23787721-6421-43a0-b0e5-4cdb83efd91d None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:41.900383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-23787721-6421-43a0-b0e5-4cdb83efd91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:41.937629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:41.962046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1375/2730] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:44:41.971737 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:41.973165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:42.033515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b84b4d-e456-4fa8-aba8-28a6d9703df1 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:42.037168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732766a-dea2-48d7-84fc-a1157d6f77e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:42.037817 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732766a-dea2-48d7-84fc-a1157d6f77e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:42.038606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732766a-dea2-48d7-84fc-a1157d6f77e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:42.038887 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732766a-dea2-48d7-84fc-a1157d6f77e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:42.048025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732766a-dea2-48d7-84fc-a1157d6f77e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:42.049529 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732766a-dea2-48d7-84fc-a1157d6f77e0 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:42.059616 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1356/2731] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:44:42.666495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23787721-6421-43a0-b0e5-4cdb83efd91d None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:42.667925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-23787721-6421-43a0-b0e5-4cdb83efd91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:42.680148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23787721-6421-43a0-b0e5-4cdb83efd91d None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:42.685169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:42.686036 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:42.686314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:42.686584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] PATH_INFO: `/v3/projects/7862e790a832494cb029313f6eb00412` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:42.688346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7862e790a832494cb029313f6eb00412)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:42.690352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:43.129423 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7862e790a832494cb029313f6eb00412', 'request_id': 'req-16e48416-e3cd-436f-956f-fd1323efac07'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.138688 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7862e790a832494cb029313f6eb00412', 'request_id': 'req-16e48416-e3cd-436f-956f-fd1323efac07'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.145975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7862e790a832494cb029313f6eb00412', 'request_id': 'req-16e48416-e3cd-436f-956f-fd1323efac07'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.247740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] The token cache is being invalidate because project 7862e790a832494cb029313f6eb00412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:43.248008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.248686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.250252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1376/2732] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:42 2022] DELETE /identity/v3/projects/7862e790a832494cb029313f6eb00412 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:43.254545 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732766a-dea2-48d7-84fc-a1157d6f77e0 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:43.266718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732766a-dea2-48d7-84fc-a1157d6f77e0 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:43.311750 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:43.313463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:43.315612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:43.332002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:43.333092 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:43.333558 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:43.333845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] PATH_INFO: `/v3/users/402b104261144879a9461521f068a8ff` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:43.335292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] RBAC: Authorizing `identity:delete_user(user_id=402b104261144879a9461521f068a8ff)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:43.338254 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:43.380981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e48416-e3cd-436f-956f-fd1323efac07 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:43.384700 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:43.385346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:43.385627 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:43.385896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:43.387659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:43.400381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:43.401848 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:43.412719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1377/2733] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:44:43.540127 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '402b104261144879a9461521f068a8ff'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.547932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '402b104261144879a9461521f068a8ff'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.548789 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '402b104261144879a9461521f068a8ff'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.564528 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '402b104261144879a9461521f068a8ff'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.566311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-8a608f5c-7e43-465c-aae2-1fe216611551 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '402b104261144879a9461521f068a8ff'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:43.636573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1357/2734] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:43 2022] DELETE /identity/v3/users/402b104261144879a9461521f068a8ff => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:44.178007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:44.179922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:44.191749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b820b5-a2f0-460d-ba93-b61747748866 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:44.259112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:44.259890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:44.260175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:44.260450 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] PATH_INFO: `/v3/projects/3bb5c3c0743245adb7624b1b2608261d` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:44.261685 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bb5c3c0743245adb7624b1b2608261d)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:44.263611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:44.271768 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:44.366363 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bb5c3c0743245adb7624b1b2608261d', 'request_id': 'req-55a19b98-9d97-4282-8c57-6e04c8321b3b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:44.372610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bb5c3c0743245adb7624b1b2608261d', 'request_id': 'req-55a19b98-9d97-4282-8c57-6e04c8321b3b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:44.378048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bb5c3c0743245adb7624b1b2608261d', 'request_id': 'req-55a19b98-9d97-4282-8c57-6e04c8321b3b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:44.520834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] The token cache is being invalidate because project 3bb5c3c0743245adb7624b1b2608261d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:44.522296 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:44.523641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-55a19b98-9d97-4282-8c57-6e04c8321b3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:44.525732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1378/2735] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:44 2022] DELETE /identity/v3/projects/3bb5c3c0743245adb7624b1b2608261d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:44.531923 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64867c-0a92-4c55-bab1-2af7cf44196e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:44.532427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64867c-0a92-4c55-bab1-2af7cf44196e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:44.532427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d64867c-0a92-4c55-bab1-2af7cf44196e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:44.566784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2d64867c-0a92-4c55-bab1-2af7cf44196e None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:44.567716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2d64867c-0a92-4c55-bab1-2af7cf44196e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:44.703548 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1358/2736] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:44.709631 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7a309-8bd3-41b1-b0c2-e48832bf963a None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:44.710115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7a309-8bd3-41b1-b0c2-e48832bf963a None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:44.710439 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b7a309-8bd3-41b1-b0c2-e48832bf963a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:44.731647 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-84b7a309-8bd3-41b1-b0c2-e48832bf963a None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:44.732929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-84b7a309-8bd3-41b1-b0c2-e48832bf963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:44.746922 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1379/2737] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:44.749493 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64867c-0a92-4c55-bab1-2af7cf44196e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:44.766933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d64867c-0a92-4c55-bab1-2af7cf44196e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:44.766933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1320b-0cfc-4acf-9b5b-30f3a71823db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:44.766933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1320b-0cfc-4acf-9b5b-30f3a71823db admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:44.766933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1320b-0cfc-4acf-9b5b-30f3a71823db admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:44.768244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1320b-0cfc-4acf-9b5b-30f3a71823db admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:44.768244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1320b-0cfc-4acf-9b5b-30f3a71823db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:44:44.768244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1320b-0cfc-4acf-9b5b-30f3a71823db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:44.769287 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1320b-0cfc-4acf-9b5b-30f3a71823db admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:44.792689 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1359/2738] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:44:44.793007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7a309-8bd3-41b1-b0c2-e48832bf963a None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:44.796808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b7a309-8bd3-41b1-b0c2-e48832bf963a None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:44.801789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83894e1-5231-4905-83fb-86f48a56fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:44.802542 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83894e1-5231-4905-83fb-86f48a56fbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:44.802892 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83894e1-5231-4905-83fb-86f48a56fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:44.803239 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83894e1-5231-4905-83fb-86f48a56fbd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:44.803942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83894e1-5231-4905-83fb-86f48a56fbd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:44.806659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83894e1-5231-4905-83fb-86f48a56fbd4 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:44.905935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1380/2739] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:44 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:44:44.910286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1320b-0cfc-4acf-9b5b-30f3a71823db admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:44.921710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1320b-0cfc-4acf-9b5b-30f3a71823db admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:44.974215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:44.984777 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a170c1b-97f2-4e3b-bfe1-307384a979a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:44.985452 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a170c1b-97f2-4e3b-bfe1-307384a979a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:44.985735 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a170c1b-97f2-4e3b-bfe1-307384a979a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:44.986017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a170c1b-97f2-4e3b-bfe1-307384a979a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:44.986725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a170c1b-97f2-4e3b-bfe1-307384a979a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:44.988709 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a170c1b-97f2-4e3b-bfe1-307384a979a6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:45.072842 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1360/2740] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:44 2022] POST /identity/v3/users => generated 292 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:45.076786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83894e1-5231-4905-83fb-86f48a56fbd4 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:45.090049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83894e1-5231-4905-83fb-86f48a56fbd4 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:45.096195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14c30-5328-4063-a3ad-ec645d762c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:45.097026 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14c30-5328-4063-a3ad-ec645d762c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:45.097409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14c30-5328-4063-a3ad-ec645d762c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:45.097788 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b14c30-5328-4063-a3ad-ec645d762c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:45.098612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b14c30-5328-4063-a3ad-ec645d762c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:45.100347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b14c30-5328-4063-a3ad-ec645d762c0a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:45.117286 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1381/2741] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:45.118795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a170c1b-97f2-4e3b-bfe1-307384a979a6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:45.130586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a170c1b-97f2-4e3b-bfe1-307384a979a6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:45.143773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6603b-0306-4704-a71c-7c78b8e39d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:45.143773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6603b-0306-4704-a71c-7c78b8e39d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:45.143773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6603b-0306-4704-a71c-7c78b8e39d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:45.143773 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6603b-0306-4704-a71c-7c78b8e39d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:45.144158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6603b-0306-4704-a71c-7c78b8e39d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:45.144158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6603b-0306-4704-a71c-7c78b8e39d4f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:45.160384 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1361/2742] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:45 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:44:45.161619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14c30-5328-4063-a3ad-ec645d762c0a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:45.175617 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b14c30-5328-4063-a3ad-ec645d762c0a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:45.182767 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d72a8e-269f-406a-ac3f-b6b937475f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:45.183669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d72a8e-269f-406a-ac3f-b6b937475f0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:45.183946 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d72a8e-269f-406a-ac3f-b6b937475f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:45.184218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d72a8e-269f-406a-ac3f-b6b937475f0e admin admin] PATH_INFO: `/v3/projects/847a72f09281440a871678d5b4ca6930/users/384dda1dfb6e4092830dac4c65aaa28f/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:45.202794 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d72a8e-269f-406a-ac3f-b6b937475f0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=847a72f09281440a871678d5b4ca6930, user_id=384dda1dfb6e4092830dac4c65aaa28f, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:45.206765 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d72a8e-269f-406a-ac3f-b6b937475f0e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:45.281608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1382/2743] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:45 2022] PUT /identity/v3/projects/847a72f09281440a871678d5b4ca6930/users/384dda1dfb6e4092830dac4c65aaa28f/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:45.293502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44624e4e-a461-49ad-98ae-43e74e86e44e None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:45.294158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44624e4e-a461-49ad-98ae-43e74e86e44e None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:45.294158 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44624e4e-a461-49ad-98ae-43e74e86e44e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:45.322017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-44624e4e-a461-49ad-98ae-43e74e86e44e None None] MFA Rules not processed for user `384dda1dfb6e4092830dac4c65aaa28f`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:45.323320 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-44624e4e-a461-49ad-98ae-43e74e86e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:45.397443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1362/2744] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:45.406759 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d72a8e-269f-406a-ac3f-b6b937475f0e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:45.408760 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-e3d72a8e-269f-406a-ac3f-b6b937475f0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:45.478477 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d72a8e-269f-406a-ac3f-b6b937475f0e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:45.483786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216938d5-ac8b-49b1-abe2-3d7579f58659 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:45.483786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216938d5-ac8b-49b1-abe2-3d7579f58659 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:45.483786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216938d5-ac8b-49b1-abe2-3d7579f58659 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:45.483786 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216938d5-ac8b-49b1-abe2-3d7579f58659 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:45.493468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216938d5-ac8b-49b1-abe2-3d7579f58659 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:45.495078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216938d5-ac8b-49b1-abe2-3d7579f58659 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:45.512618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1383/2745] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:45.527333 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44624e4e-a461-49ad-98ae-43e74e86e44e None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:45.612154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44624e4e-a461-49ad-98ae-43e74e86e44e None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:45.618132 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:45.619215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:45.619531 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:45.619771 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] PATH_INFO: `/v3/users/384dda1dfb6e4092830dac4c65aaa28f` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:45.621032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=384dda1dfb6e4092830dac4c65aaa28f)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:45.623036 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:45.822151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384dda1dfb6e4092830dac4c65aaa28f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:45.832292 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384dda1dfb6e4092830dac4c65aaa28f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:45.833163 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384dda1dfb6e4092830dac4c65aaa28f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:45.838742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:45.847968 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384dda1dfb6e4092830dac4c65aaa28f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:45.848765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384dda1dfb6e4092830dac4c65aaa28f'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:45.921996 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1363/2746] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:45 2022] DELETE /identity/v3/users/384dda1dfb6e4092830dac4c65aaa28f => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:45.926764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78590c-d1d7-4b44-8bba-2e7462fa2dbe None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:45.927632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78590c-d1d7-4b44-8bba-2e7462fa2dbe None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:45.928144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a78590c-d1d7-4b44-8bba-2e7462fa2dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:45.948052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-1a78590c-d1d7-4b44-8bba-2e7462fa2dbe None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:45.949858 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1a78590c-d1d7-4b44-8bba-2e7462fa2dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:45.991408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:46.021530 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1384/2747] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:46.031226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:46.032696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:46.089244 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0c7168-486b-4102-a754-02449073b077 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:46.093147 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee27590-bb26-4798-8de7-efc1d3e7557e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:46.093800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27590-bb26-4798-8de7-efc1d3e7557e service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:46.094088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27590-bb26-4798-8de7-efc1d3e7557e service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:46.094392 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee27590-bb26-4798-8de7-efc1d3e7557e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:46.103906 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27590-bb26-4798-8de7-efc1d3e7557e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:46.105374 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee27590-bb26-4798-8de7-efc1d3e7557e service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:46.120437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1364/2748] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:46.587446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78590c-d1d7-4b44-8bba-2e7462fa2dbe None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:46.589575 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-1a78590c-d1d7-4b44-8bba-2e7462fa2dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:46.609057 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a78590c-d1d7-4b44-8bba-2e7462fa2dbe None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:46.614975 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:46.617140 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:46.623161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:46.623161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] PATH_INFO: `/v3/projects/847a72f09281440a871678d5b4ca6930` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:46.623161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] RBAC: Authorizing `identity:delete_project(project_id=847a72f09281440a871678d5b4ca6930)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:46.629732 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:46.739461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847a72f09281440a871678d5b4ca6930', 'request_id': 'req-834a71b5-d70e-4198-83d2-ab9f54e3013a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:46.750967 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847a72f09281440a871678d5b4ca6930', 'request_id': 'req-834a71b5-d70e-4198-83d2-ab9f54e3013a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:46.757403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847a72f09281440a871678d5b4ca6930', 'request_id': 'req-834a71b5-d70e-4198-83d2-ab9f54e3013a'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:46.830327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] The token cache is being invalidate because project 847a72f09281440a871678d5b4ca6930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:46.830614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:46.831249 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-834a71b5-d70e-4198-83d2-ab9f54e3013a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:46.833157 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1385/2749] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:46 2022] DELETE /identity/v3/projects/847a72f09281440a871678d5b4ca6930 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:46.842665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784638-c842-41ac-9e27-8320c0c954c9 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:46.842665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784638-c842-41ac-9e27-8320c0c954c9 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:46.842665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18784638-c842-41ac-9e27-8320c0c954c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:46.865742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-18784638-c842-41ac-9e27-8320c0c954c9 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:46.865742 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-18784638-c842-41ac-9e27-8320c0c954c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:46.929549 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1365/2750] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:46.937583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de9cd7-5421-4573-aee2-418be8bf7f8c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:46.937877 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de9cd7-5421-4573-aee2-418be8bf7f8c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:46.938219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de9cd7-5421-4573-aee2-418be8bf7f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:46.962645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-41de9cd7-5421-4573-aee2-418be8bf7f8c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:46.962645 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-41de9cd7-5421-4573-aee2-418be8bf7f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:46.968897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1386/2751] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:46.973125 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18784638-c842-41ac-9e27-8320c0c954c9 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:46.983630 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18784638-c842-41ac-9e27-8320c0c954c9 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:46.988394 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693484b-a474-4934-a339-894e0f362ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:46.989124 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693484b-a474-4934-a339-894e0f362ffd admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:46.989411 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693484b-a474-4934-a339-894e0f362ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:46.989691 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693484b-a474-4934-a339-894e0f362ffd admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:46.990682 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693484b-a474-4934-a339-894e0f362ffd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:44:46.991002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693484b-a474-4934-a339-894e0f362ffd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:46.992885 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3693484b-a474-4934-a339-894e0f362ffd admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.005723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1366/2752] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:44:47.010574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de9cd7-5421-4573-aee2-418be8bf7f8c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:47.022225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de9cd7-5421-4573-aee2-418be8bf7f8c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:47.029193 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e02f66-7887-493e-a1f7-097a3b73134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:47.029875 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e02f66-7887-493e-a1f7-097a3b73134e admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.030158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e02f66-7887-493e-a1f7-097a3b73134e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.030502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e02f66-7887-493e-a1f7-097a3b73134e admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.031131 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e02f66-7887-493e-a1f7-097a3b73134e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:47.033224 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e02f66-7887-493e-a1f7-097a3b73134e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.120516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1387/2753] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:47 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:47.121953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693484b-a474-4934-a339-894e0f362ffd admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:47.132807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693484b-a474-4934-a339-894e0f362ffd admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:47.198145 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf22b85-33e0-41b9-803e-984cdf63a183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:47.198987 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf22b85-33e0-41b9-803e-984cdf63a183 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.199184 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf22b85-33e0-41b9-803e-984cdf63a183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.199466 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf22b85-33e0-41b9-803e-984cdf63a183 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.200174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf22b85-33e0-41b9-803e-984cdf63a183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:47.202196 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf22b85-33e0-41b9-803e-984cdf63a183 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.297791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:47.303889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1367/2754] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:47 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:47.308380 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e02f66-7887-493e-a1f7-097a3b73134e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:47.318992 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e02f66-7887-493e-a1f7-097a3b73134e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:47.324517 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e28ef-a5da-4829-a17a-e8231b5b5e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:47.325267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e28ef-a5da-4829-a17a-e8231b5b5e17 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.325622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e28ef-a5da-4829-a17a-e8231b5b5e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.326024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e28ef-a5da-4829-a17a-e8231b5b5e17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.326824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e28ef-a5da-4829-a17a-e8231b5b5e17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:47.328531 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e28ef-a5da-4829-a17a-e8231b5b5e17 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.340862 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1388/2755] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:47.345002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf22b85-33e0-41b9-803e-984cdf63a183 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:47.356781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf22b85-33e0-41b9-803e-984cdf63a183 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:47.361956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570286e5-68bc-4de5-aced-f8dd81eb028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:47.362621 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570286e5-68bc-4de5-aced-f8dd81eb028c admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.362901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570286e5-68bc-4de5-aced-f8dd81eb028c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.363179 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570286e5-68bc-4de5-aced-f8dd81eb028c admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.364610 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570286e5-68bc-4de5-aced-f8dd81eb028c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:47.365880 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570286e5-68bc-4de5-aced-f8dd81eb028c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.383659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1368/2756] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:47.383961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e28ef-a5da-4829-a17a-e8231b5b5e17 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:47.393091 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e28ef-a5da-4829-a17a-e8231b5b5e17 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:47.397903 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22790c5f-8c44-47af-bbeb-4237c7480719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:47.399958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22790c5f-8c44-47af-bbeb-4237c7480719 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.400103 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22790c5f-8c44-47af-bbeb-4237c7480719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.400600 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22790c5f-8c44-47af-bbeb-4237c7480719 admin admin] PATH_INFO: `/v3/projects/7378e9dcb47245fe83769d4f22639744/users/28c3bb7463bc45bca91ec33458f65e67/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.417039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22790c5f-8c44-47af-bbeb-4237c7480719 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7378e9dcb47245fe83769d4f22639744, user_id=28c3bb7463bc45bca91ec33458f65e67, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:47.419778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22790c5f-8c44-47af-bbeb-4237c7480719 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.486818 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1389/2757] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:47 2022] PUT /identity/v3/projects/7378e9dcb47245fe83769d4f22639744/users/28c3bb7463bc45bca91ec33458f65e67/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:44:47.499913 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89106c8-b0bc-4d07-a2b4-414938c01d9d None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.500295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89106c8-b0bc-4d07-a2b4-414938c01d9d None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.502034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89106c8-b0bc-4d07-a2b4-414938c01d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.543039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-a89106c8-b0bc-4d07-a2b4-414938c01d9d None None] MFA Rules not processed for user `28c3bb7463bc45bca91ec33458f65e67`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:47.544262 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a89106c8-b0bc-4d07-a2b4-414938c01d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:47.615370 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1369/2758] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:47.620676 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22790c5f-8c44-47af-bbeb-4237c7480719 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:47.678437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:47.684305 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22790c5f-8c44-47af-bbeb-4237c7480719 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:47.689094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69766578-b0b6-4202-a434-7d809f20a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:47.689784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69766578-b0b6-4202-a434-7d809f20a2de admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.690072 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69766578-b0b6-4202-a434-7d809f20a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.690347 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69766578-b0b6-4202-a434-7d809f20a2de admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.691069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69766578-b0b6-4202-a434-7d809f20a2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:47.693019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69766578-b0b6-4202-a434-7d809f20a2de admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.756608 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1390/2759] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:47 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:47.761428 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89106c8-b0bc-4d07-a2b4-414938c01d9d None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:47.772756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89106c8-b0bc-4d07-a2b4-414938c01d9d None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:47.845122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9d535-02fd-4964-9010-fc05067a760b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:47.845810 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9d535-02fd-4964-9010-fc05067a760b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.848826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9d535-02fd-4964-9010-fc05067a760b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.848826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9d535-02fd-4964-9010-fc05067a760b admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.848826 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9d535-02fd-4964-9010-fc05067a760b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:47.849134 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9d535-02fd-4964-9010-fc05067a760b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.924296 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1370/2760] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:47 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:47.925570 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69766578-b0b6-4202-a434-7d809f20a2de admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:47.936215 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69766578-b0b6-4202-a434-7d809f20a2de admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:47.940748 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8875af-7011-42c0-ae3a-70106a12508b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:47.941508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8875af-7011-42c0-ae3a-70106a12508b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.941792 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8875af-7011-42c0-ae3a-70106a12508b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.942067 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8875af-7011-42c0-ae3a-70106a12508b admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.942783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8875af-7011-42c0-ae3a-70106a12508b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:47.944405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8875af-7011-42c0-ae3a-70106a12508b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.958578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1391/2761] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:47.959990 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9d535-02fd-4964-9010-fc05067a760b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:47.970977 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9d535-02fd-4964-9010-fc05067a760b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:47.975665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b5889-5a63-4b9c-8a14-2b4f9430ef6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:47.976325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b5889-5a63-4b9c-8a14-2b4f9430ef6c admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:47.976647 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b5889-5a63-4b9c-8a14-2b4f9430ef6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:47.976957 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b5889-5a63-4b9c-8a14-2b4f9430ef6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:47.978058 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b5889-5a63-4b9c-8a14-2b4f9430ef6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:47.979726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b5889-5a63-4b9c-8a14-2b4f9430ef6c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:47.989895 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1371/2762] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:44:47.994390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8875af-7011-42c0-ae3a-70106a12508b admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:48.004655 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8875af-7011-42c0-ae3a-70106a12508b admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:48.009508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8f83-ccf7-42b6-8bc8-e928bc402d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:48.010446 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8f83-ccf7-42b6-8bc8-e928bc402d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:48.011005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8f83-ccf7-42b6-8bc8-e928bc402d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:48.011005 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e8f83-ccf7-42b6-8bc8-e928bc402d19 admin admin] PATH_INFO: `/v3/projects/f2651b50abe9449da8257f9bf2155ad9/users/d002bc49851a404ca691cabd24e873ed/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:48.026369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e8f83-ccf7-42b6-8bc8-e928bc402d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2651b50abe9449da8257f9bf2155ad9, user_id=d002bc49851a404ca691cabd24e873ed, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:48.029054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559e8f83-ccf7-42b6-8bc8-e928bc402d19 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:48.109703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1392/2763] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:47 2022] PUT /identity/v3/projects/f2651b50abe9449da8257f9bf2155ad9/users/d002bc49851a404ca691cabd24e873ed/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:48.119869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c4e6-1e26-4138-a18e-c9a4c5081d35 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:48.121017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c4e6-1e26-4138-a18e-c9a4c5081d35 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:48.121017 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc45c4e6-1e26-4138-a18e-c9a4c5081d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:48.149713 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-dc45c4e6-1e26-4138-a18e-c9a4c5081d35 None None] MFA Rules not processed for user `d002bc49851a404ca691cabd24e873ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:48.151032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dc45c4e6-1e26-4138-a18e-c9a4c5081d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:48.198524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:48.219344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1372/2764] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:48.223569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8f83-ccf7-42b6-8bc8-e928bc402d19 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:48.315721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e8f83-ccf7-42b6-8bc8-e928bc402d19 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:48.320658 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59828412-b19e-4244-8f6b-5e274dbd3538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:48.321935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828412-b19e-4244-8f6b-5e274dbd3538 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:48.322233 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828412-b19e-4244-8f6b-5e274dbd3538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:48.322514 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59828412-b19e-4244-8f6b-5e274dbd3538 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:48.323220 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59828412-b19e-4244-8f6b-5e274dbd3538 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:48.325272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59828412-b19e-4244-8f6b-5e274dbd3538 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:48.436763 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1393/2765] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:48 2022] POST /identity/v3/projects => generated 377 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:48.441025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45c4e6-1e26-4138-a18e-c9a4c5081d35 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:48.459621 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc45c4e6-1e26-4138-a18e-c9a4c5081d35 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:48.531671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a228-f3b4-445f-9dce-23881f0a8f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:48.532462 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a228-f3b4-445f-9dce-23881f0a8f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:48.532861 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a228-f3b4-445f-9dce-23881f0a8f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:48.533524 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a228-f3b4-445f-9dce-23881f0a8f46 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:48.533985 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37a228-f3b4-445f-9dce-23881f0a8f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:48.536105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37a228-f3b4-445f-9dce-23881f0a8f46 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:48.632898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1373/2766] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:48 2022] POST /identity/v3/users => generated 295 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:44:48.637145 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59828412-b19e-4244-8f6b-5e274dbd3538 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:48.648558 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59828412-b19e-4244-8f6b-5e274dbd3538 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:48.653651 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b12c4-c62e-49b9-afb3-668081788e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:48.654315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b12c4-c62e-49b9-afb3-668081788e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:48.654614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b12c4-c62e-49b9-afb3-668081788e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:48.654896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b12c4-c62e-49b9-afb3-668081788e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:48.655603 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b12c4-c62e-49b9-afb3-668081788e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:48.657242 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b12c4-c62e-49b9-afb3-668081788e86 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:48.668829 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1394/2767] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:48.672800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a228-f3b4-445f-9dce-23881f0a8f46 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:48.683241 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a228-f3b4-445f-9dce-23881f0a8f46 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:48.687749 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e18b8-efdc-48e2-9589-413f6760c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:48.688701 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e18b8-efdc-48e2-9589-413f6760c17f admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:48.689585 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e18b8-efdc-48e2-9589-413f6760c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:48.689879 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e18b8-efdc-48e2-9589-413f6760c17f admin admin] PATH_INFO: `/v3/projects/03a2275df9f9475da125df51fbfcb63c/users/3af342db45364b5b82e37db1409c427c/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:48.705102 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e18b8-efdc-48e2-9589-413f6760c17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a2275df9f9475da125df51fbfcb63c, user_id=3af342db45364b5b82e37db1409c427c, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:48.707659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e18b8-efdc-48e2-9589-413f6760c17f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:48.783848 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1374/2768] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:48 2022] PUT /identity/v3/projects/03a2275df9f9475da125df51fbfcb63c/users/3af342db45364b5b82e37db1409c427c/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:48.787785 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b12c4-c62e-49b9-afb3-668081788e86 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:48.798784 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b12c4-c62e-49b9-afb3-668081788e86 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:48.862111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d961-a419-4d34-af52-05d0dcd0475b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:48.862951 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d961-a419-4d34-af52-05d0dcd0475b admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:48.863340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d961-a419-4d34-af52-05d0dcd0475b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:48.863709 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d961-a419-4d34-af52-05d0dcd0475b admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:48.864569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d961-a419-4d34-af52-05d0dcd0475b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:48.866520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d961-a419-4d34-af52-05d0dcd0475b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:48.883052 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1395/2769] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:48.884358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e18b8-efdc-48e2-9589-413f6760c17f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:48.898794 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e18b8-efdc-48e2-9589-413f6760c17f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:48.904264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8202-3285-46c1-a41e-ab58819fd451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:48.905257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8202-3285-46c1-a41e-ab58819fd451 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:48.905608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8202-3285-46c1-a41e-ab58819fd451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:48.905953 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c8202-3285-46c1-a41e-ab58819fd451 admin admin] PATH_INFO: `/v3/projects/03a2275df9f9475da125df51fbfcb63c/users/3af342db45364b5b82e37db1409c427c/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:48.908029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c8202-3285-46c1-a41e-ab58819fd451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a2275df9f9475da125df51fbfcb63c, user_id=3af342db45364b5b82e37db1409c427c, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:48.910795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c8202-3285-46c1-a41e-ab58819fd451 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:48.923177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1375/2770] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:48 2022] PUT /identity/v3/projects/03a2275df9f9475da125df51fbfcb63c/users/3af342db45364b5b82e37db1409c427c/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:48.934007 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966a3c2-f7dc-477c-8472-e7209b86793c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:48.934299 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966a3c2-f7dc-477c-8472-e7209b86793c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:48.934580 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f966a3c2-f7dc-477c-8472-e7209b86793c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:48.963422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f966a3c2-f7dc-477c-8472-e7209b86793c None None] MFA Rules not processed for user `3af342db45364b5b82e37db1409c427c`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:48.964758 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f966a3c2-f7dc-477c-8472-e7209b86793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:48.968904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:49.046142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1396/2771] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:49.057322 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8202-3285-46c1-a41e-ab58819fd451 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:49.059105 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f05c8202-3285-46c1-a41e-ab58819fd451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:49.124351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c8202-3285-46c1-a41e-ab58819fd451 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:49.129267 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d529a7-a4b0-4a87-ac3e-6b58a819b01b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:49.129935 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d529a7-a4b0-4a87-ac3e-6b58a819b01b service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:49.130225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d529a7-a4b0-4a87-ac3e-6b58a819b01b service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:49.130506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d529a7-a4b0-4a87-ac3e-6b58a819b01b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:49.188238 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:49.198155 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d529a7-a4b0-4a87-ac3e-6b58a819b01b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:49.199611 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d529a7-a4b0-4a87-ac3e-6b58a819b01b service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:49.209933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1376/2772] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:50.885071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966a3c2-f7dc-477c-8472-e7209b86793c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:50.886526 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f966a3c2-f7dc-477c-8472-e7209b86793c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:50.967226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f966a3c2-f7dc-477c-8472-e7209b86793c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:50.976288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:50.977610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:50.977764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:50.978300 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:50.979960 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:50.995168 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:50.996804 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:51.008614 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1397/2773] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:51.021827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d529a7-a4b0-4a87-ac3e-6b58a819b01b service cinder] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:51.024870 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c5d529a7-a4b0-4a87-ac3e-6b58a819b01b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:51.102542 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d529a7-a4b0-4a87-ac3e-6b58a819b01b service cinder] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:51.107626 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:51.108559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:51.108845 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:51.121434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] PATH_INFO: `/v3/users/f3cd1d48ead14854a5f9f532efcc1e62` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:51.121434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3cd1d48ead14854a5f9f532efcc1e62)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:51.121434 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:51.314457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:51.316876 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:51.329213 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cd1d48ead14854a5f9f532efcc1e62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.329791 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8691680-1664-471d-ad37-bf7433479b73 service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:51.333657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b10b8-65a6-4ef9-8317-5503277a54f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:51.334312 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b10b8-65a6-4ef9-8317-5503277a54f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:51.334619 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b10b8-65a6-4ef9-8317-5503277a54f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:51.334865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b10b8-65a6-4ef9-8317-5503277a54f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:51.338598 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cd1d48ead14854a5f9f532efcc1e62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.339464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cd1d48ead14854a5f9f532efcc1e62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.355347 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cd1d48ead14854a5f9f532efcc1e62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.356733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cd1d48ead14854a5f9f532efcc1e62'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.401340 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b10b8-65a6-4ef9-8317-5503277a54f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:51.403508 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b10b8-65a6-4ef9-8317-5503277a54f9 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:51.413766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1398/2774] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:44:51.451510 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1377/2775] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:51 2022] DELETE /identity/v3/users/f3cd1d48ead14854a5f9f532efcc1e62 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:51.711463 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b10b8-65a6-4ef9-8317-5503277a54f9 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:51.726195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b10b8-65a6-4ef9-8317-5503277a54f9 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:51.755025 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=100 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:51.784433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:51.785307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:51.785583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:51.785936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] PATH_INFO: `/v3/projects/f13c4f9ee9c444d9b9a0d2c2e3ec9142` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:51.787109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f13c4f9ee9c444d9b9a0d2c2e3ec9142)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:51.789061 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:51.898717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'request_id': 'req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.906287 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'request_id': 'req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.912914 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'request_id': 'req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.988225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] The token cache is being invalidate because project f13c4f9ee9c444d9b9a0d2c2e3ec9142 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:51.988547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.997352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:51.997352 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1399/2776] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:51 2022] DELETE /identity/v3/projects/f13c4f9ee9c444d9b9a0d2c2e3ec9142 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:52.000014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:52.001482 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:52.015454 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15d512-3f40-4f21-81d6-76b6d64cc784 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:52.075603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:52.076494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:52.076815 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:52.077108 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] PATH_INFO: `/v3/users/83c595d1850240e99408c00c5e92c8d3` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:52.078264 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] RBAC: Authorizing `identity:delete_user(user_id=83c595d1850240e99408c00c5e92c8d3)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:52.080169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:52.093378 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:52.367901 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83c595d1850240e99408c00c5e92c8d3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:52.374659 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83c595d1850240e99408c00c5e92c8d3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:52.375328 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83c595d1850240e99408c00c5e92c8d3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:52.387638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83c595d1850240e99408c00c5e92c8d3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:52.388281 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-353faec2-6d1b-46c5-9f82-c32e423fafed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83c595d1850240e99408c00c5e92c8d3'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:52.457126 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1378/2777] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:51 2022] DELETE /identity/v3/users/83c595d1850240e99408c00c5e92c8d3 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:52.734918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:52.737679 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:52.750832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbc0e7e-cde4-4a98-90bd-d1eb75dba59c admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:52.809092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:52.809981 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:52.810266 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:52.810536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] PATH_INFO: `/v3/projects/21d0ab14c2cb4b7ab6bd84d2407011e7` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:52.811722 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d0ab14c2cb4b7ab6bd84d2407011e7)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:52.813666 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:52.938547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d0ab14c2cb4b7ab6bd84d2407011e7', 'request_id': 'req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:52.944800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d0ab14c2cb4b7ab6bd84d2407011e7', 'request_id': 'req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:52.950854 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:52.952500 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d0ab14c2cb4b7ab6bd84d2407011e7', 'request_id': 'req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:53.054404 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] The token cache is being invalidate because project 21d0ab14c2cb4b7ab6bd84d2407011e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:53.054782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:53.055592 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:53.057355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1400/2778] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:52 2022] DELETE /identity/v3/projects/21d0ab14c2cb4b7ab6bd84d2407011e7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:53.062301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfeffb-e1c6-44b4-847d-7ca769824a7f None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.062591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfeffb-e1c6-44b4-847d-7ca769824a7f None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.062866 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfeffb-e1c6-44b4-847d-7ca769824a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.083890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2bcfeffb-e1c6-44b4-847d-7ca769824a7f None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:53.085190 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2bcfeffb-e1c6-44b4-847d-7ca769824a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:53.112917 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:53.114397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:53.159710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1379/2779] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:44:53.167559 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1cff6-dbd8-49ba-88b0-5968a65c24e7 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.167846 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1cff6-dbd8-49ba-88b0-5968a65c24e7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.168173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1cff6-dbd8-49ba-88b0-5968a65c24e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.185241 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439fb0e-6105-43f4-bfe4-6a8a88d88f61 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:53.186836 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-2bc1cff6-dbd8-49ba-88b0-5968a65c24e7 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:53.188028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-2bc1cff6-dbd8-49ba-88b0-5968a65c24e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:53.189041 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d13d1a-76ca-43ea-8be2-8c1c651a2d05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:53.189692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d13d1a-76ca-43ea-8be2-8c1c651a2d05 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.194027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d13d1a-76ca-43ea-8be2-8c1c651a2d05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.194027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d13d1a-76ca-43ea-8be2-8c1c651a2d05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.194027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-80d13d1a-76ca-43ea-8be2-8c1c651a2d05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:53.196772 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1380/2780] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:44:53.201071 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1cff6-dbd8-49ba-88b0-5968a65c24e7 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:53.210226 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1cff6-dbd8-49ba-88b0-5968a65c24e7 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:53.216455 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8098d9-62b1-4047-9357-a6cc267669c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:53.217143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8098d9-62b1-4047-9357-a6cc267669c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.218708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8098d9-62b1-4047-9357-a6cc267669c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.218708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8098d9-62b1-4047-9357-a6cc267669c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.218708 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8098d9-62b1-4047-9357-a6cc267669c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:44:53.219011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8098d9-62b1-4047-9357-a6cc267669c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:53.220443 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8098d9-62b1-4047-9357-a6cc267669c6 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:53.232797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1381/2781] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:44:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:44:53.236938 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8098d9-62b1-4047-9357-a6cc267669c6 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:53.250386 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8098d9-62b1-4047-9357-a6cc267669c6 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:53.255242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735dcda-f241-4cec-8853-9a567730a3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:53.255892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735dcda-f241-4cec-8853-9a567730a3c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.256168 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735dcda-f241-4cec-8853-9a567730a3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.256447 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735dcda-f241-4cec-8853-9a567730a3c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.257164 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735dcda-f241-4cec-8853-9a567730a3c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:53.259756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b735dcda-f241-4cec-8853-9a567730a3c9 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:53.266611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d13d1a-76ca-43ea-8be2-8c1c651a2d05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:53.268115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d13d1a-76ca-43ea-8be2-8c1c651a2d05 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:53.278749 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1401/2782] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:53.378907 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1382/2783] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:53 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:44:53.382900 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d13d1a-76ca-43ea-8be2-8c1c651a2d05 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:53.393689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d13d1a-76ca-43ea-8be2-8c1c651a2d05 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:53.451740 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd08135-1c53-4d43-8a80-19dccc33c4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:53.452409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd08135-1c53-4d43-8a80-19dccc33c4b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.452724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd08135-1c53-4d43-8a80-19dccc33c4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.453001 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd08135-1c53-4d43-8a80-19dccc33c4b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.453681 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd08135-1c53-4d43-8a80-19dccc33c4b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:53.455598 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd08135-1c53-4d43-8a80-19dccc33c4b6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:53.553111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1402/2784] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:53 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:53.557816 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735dcda-f241-4cec-8853-9a567730a3c9 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:53.578073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b735dcda-f241-4cec-8853-9a567730a3c9 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:53.592456 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538620-bbb4-4f6d-a54d-27ff325c4635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:53.593348 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538620-bbb4-4f6d-a54d-27ff325c4635 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.593727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538620-bbb4-4f6d-a54d-27ff325c4635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.594181 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538620-bbb4-4f6d-a54d-27ff325c4635 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.595095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77538620-bbb4-4f6d-a54d-27ff325c4635 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:53.599876 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77538620-bbb4-4f6d-a54d-27ff325c4635 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:53.615174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1383/2785] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:53.620149 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd08135-1c53-4d43-8a80-19dccc33c4b6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:53.630850 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd08135-1c53-4d43-8a80-19dccc33c4b6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:53.636529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51799eab-5147-4982-ac44-34be149a23c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:53.637273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51799eab-5147-4982-ac44-34be149a23c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.637587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51799eab-5147-4982-ac44-34be149a23c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.637872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51799eab-5147-4982-ac44-34be149a23c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.638581 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51799eab-5147-4982-ac44-34be149a23c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:53.640227 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51799eab-5147-4982-ac44-34be149a23c2 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:53.650901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1403/2786] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:44:53.655072 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538620-bbb4-4f6d-a54d-27ff325c4635 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:53.665248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538620-bbb4-4f6d-a54d-27ff325c4635 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:53.669855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4495-3a0e-4d83-9524-d6a1bc7e4127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:53.670730 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4495-3a0e-4d83-9524-d6a1bc7e4127 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.671010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4495-3a0e-4d83-9524-d6a1bc7e4127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.671285 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8a4495-3a0e-4d83-9524-d6a1bc7e4127 admin admin] PATH_INFO: `/v3/projects/f5e67d0f06be415794efd436655904b3/users/d3d92c0c69cf470e8aecb57e79e5a7fe/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.686385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4495-3a0e-4d83-9524-d6a1bc7e4127 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5e67d0f06be415794efd436655904b3, user_id=d3d92c0c69cf470e8aecb57e79e5a7fe, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:53.689052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8a4495-3a0e-4d83-9524-d6a1bc7e4127 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:53.782875 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1384/2787] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:53 2022] PUT /identity/v3/projects/f5e67d0f06be415794efd436655904b3/users/d3d92c0c69cf470e8aecb57e79e5a7fe/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:44:53.793864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbb4a7-8421-4fb7-8573-511f1b8ef85b None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.793864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbb4a7-8421-4fb7-8573-511f1b8ef85b None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.793864 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efbb4a7-8421-4fb7-8573-511f1b8ef85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.806464 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-8efbb4a7-8421-4fb7-8573-511f1b8ef85b None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:53.807691 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8efbb4a7-8421-4fb7-8573-511f1b8ef85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:53.819475 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:53.869092 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1404/2788] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:53.878716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4495-3a0e-4d83-9524-d6a1bc7e4127 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:53.880418 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-da8a4495-3a0e-4d83-9524-d6a1bc7e4127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:53.895146 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:53.939501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8a4495-3a0e-4d83-9524-d6a1bc7e4127 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:53.943351 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec41680-ad11-4074-bb02-5e9edcff2483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:53.943988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec41680-ad11-4074-bb02-5e9edcff2483 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:53.944271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec41680-ad11-4074-bb02-5e9edcff2483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:53.944582 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec41680-ad11-4074-bb02-5e9edcff2483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:53.953726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec41680-ad11-4074-bb02-5e9edcff2483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:53.955154 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec41680-ad11-4074-bb02-5e9edcff2483 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:53.964767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1385/2789] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:44:54.601780 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbb4a7-8421-4fb7-8573-511f1b8ef85b None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:54.603389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8efbb4a7-8421-4fb7-8573-511f1b8ef85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:54.615160 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efbb4a7-8421-4fb7-8573-511f1b8ef85b None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:54.620280 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:54.621195 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:54.621555 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:54.621839 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] PATH_INFO: `/v3/users/b86917d4d6284a71ae479899337fcb32` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:54.623022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86917d4d6284a71ae479899337fcb32)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:54.625094 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:54.838166 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86917d4d6284a71ae479899337fcb32'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:54.851789 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86917d4d6284a71ae479899337fcb32'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:54.897177 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86917d4d6284a71ae479899337fcb32'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:54.897807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86917d4d6284a71ae479899337fcb32'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:54.898405 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86917d4d6284a71ae479899337fcb32'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:54.911890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1405/2790] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:54 2022] DELETE /identity/v3/users/b86917d4d6284a71ae479899337fcb32 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:54.916587 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659db69-b565-437c-9e65-b60b6e003063 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:54.917083 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659db69-b565-437c-9e65-b60b6e003063 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:54.917205 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6659db69-b565-437c-9e65-b60b6e003063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:54.934608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-6659db69-b565-437c-9e65-b60b6e003063 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:54.935800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6659db69-b565-437c-9e65-b60b6e003063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:54.997830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1386/2791] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:55.007547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:55.009035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:55.078932 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0604158d-c9c9-45b6-8342-213723913bb6 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:55.082977 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd1a305-cc7e-40c4-8ee9-eb73bbb96baa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:55.083657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1a305-cc7e-40c4-8ee9-eb73bbb96baa service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:55.083936 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1a305-cc7e-40c4-8ee9-eb73bbb96baa service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:55.084216 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd1a305-cc7e-40c4-8ee9-eb73bbb96baa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:55.097196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1a305-cc7e-40c4-8ee9-eb73bbb96baa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:55.097196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd1a305-cc7e-40c4-8ee9-eb73bbb96baa service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:55.110075 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1406/2792] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:55.940883 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659db69-b565-437c-9e65-b60b6e003063 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:55.943286 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-6659db69-b565-437c-9e65-b60b6e003063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:55.957034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6659db69-b565-437c-9e65-b60b6e003063 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:55.962841 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:55.963813 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:55.964362 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:55.964738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] PATH_INFO: `/v3/projects/ae112ac32fc240929a6687cb330f95c9` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:55.966195 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae112ac32fc240929a6687cb330f95c9)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:55.968246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:56.127136 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae112ac32fc240929a6687cb330f95c9', 'request_id': 'req-7e7f327d-918f-43f6-ab90-50289f97f85b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:56.147752 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae112ac32fc240929a6687cb330f95c9', 'request_id': 'req-7e7f327d-918f-43f6-ab90-50289f97f85b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:56.157741 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae112ac32fc240929a6687cb330f95c9', 'request_id': 'req-7e7f327d-918f-43f6-ab90-50289f97f85b'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:56.294942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] The token cache is being invalidate because project ae112ac32fc240929a6687cb330f95c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:44:56.295234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:56.296780 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7e7f327d-918f-43f6-ab90-50289f97f85b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:56.301649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1387/2793] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:55 2022] DELETE /identity/v3/projects/ae112ac32fc240929a6687cb330f95c9 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:56.306218 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee5a27-2d07-4e5f-99bc-943379b96106 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:56.306710 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee5a27-2d07-4e5f-99bc-943379b96106 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:56.308838 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee5a27-2d07-4e5f-99bc-943379b96106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:56.341776 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-49ee5a27-2d07-4e5f-99bc-943379b96106 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:56.345516 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-49ee5a27-2d07-4e5f-99bc-943379b96106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:56.384840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:56.420802 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1407/2794] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:56.428997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde38bf-ddae-4c00-bd7e-7a816ef3a0ea None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:56.429427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde38bf-ddae-4c00-bd7e-7a816ef3a0ea None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:56.429783 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dde38bf-ddae-4c00-bd7e-7a816ef3a0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:56.456095 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-1dde38bf-ddae-4c00-bd7e-7a816ef3a0ea None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:56.457508 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-1dde38bf-ddae-4c00-bd7e-7a816ef3a0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:56.472637 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1388/2795] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:56.476583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee5a27-2d07-4e5f-99bc-943379b96106 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:56.491171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee5a27-2d07-4e5f-99bc-943379b96106 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:56.499994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d4aa3-d10d-4bff-8955-70668c533336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:56.500724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d4aa3-d10d-4bff-8955-70668c533336 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:56.501034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d4aa3-d10d-4bff-8955-70668c533336 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:56.503071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d4aa3-d10d-4bff-8955-70668c533336 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:56.503071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d4aa3-d10d-4bff-8955-70668c533336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:44:56.503071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d4aa3-d10d-4bff-8955-70668c533336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:56.503982 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d4aa3-d10d-4bff-8955-70668c533336 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:56.516872 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1408/2796] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:44:56.527151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde38bf-ddae-4c00-bd7e-7a816ef3a0ea None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:56.534521 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dde38bf-ddae-4c00-bd7e-7a816ef3a0ea None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:56.542165 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b78b9-3cbd-410c-9f99-203ab18e2c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:56.543037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b78b9-3cbd-410c-9f99-203ab18e2c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:56.543424 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b78b9-3cbd-410c-9f99-203ab18e2c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:56.543809 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b78b9-3cbd-410c-9f99-203ab18e2c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:56.544684 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b78b9-3cbd-410c-9f99-203ab18e2c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:56.546739 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925b78b9-3cbd-410c-9f99-203ab18e2c0c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:56.633032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1389/2797] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:44:56 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:56.637488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d4aa3-d10d-4bff-8955-70668c533336 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:56.652351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d4aa3-d10d-4bff-8955-70668c533336 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:56.749820 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13935390-696b-4867-8ea6-d0391090ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:56.750586 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13935390-696b-4867-8ea6-d0391090ee98 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:56.750871 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13935390-696b-4867-8ea6-d0391090ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:56.751172 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13935390-696b-4867-8ea6-d0391090ee98 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:56.751890 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13935390-696b-4867-8ea6-d0391090ee98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:56.753897 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13935390-696b-4867-8ea6-d0391090ee98 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:56.821361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1409/2798] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:44:56 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:44:56.823230 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b78b9-3cbd-410c-9f99-203ab18e2c0c admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:56.835029 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b78b9-3cbd-410c-9f99-203ab18e2c0c admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:56.840665 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2672e0f-e05f-4bbb-a2f0-99542a11867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:56.841349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2672e0f-e05f-4bbb-a2f0-99542a11867e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:56.841639 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2672e0f-e05f-4bbb-a2f0-99542a11867e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:56.842051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2672e0f-e05f-4bbb-a2f0-99542a11867e admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:56.842645 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2672e0f-e05f-4bbb-a2f0-99542a11867e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:56.844338 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2672e0f-e05f-4bbb-a2f0-99542a11867e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:56.850994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:56.862332 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1390/2799] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:56.863196 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13935390-696b-4867-8ea6-d0391090ee98 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:56.876024 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13935390-696b-4867-8ea6-d0391090ee98 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:56.883271 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48b7613-b3fe-4d75-9588-87cd0f7d485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:56.884398 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b7613-b3fe-4d75-9588-87cd0f7d485d admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:56.885389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b7613-b3fe-4d75-9588-87cd0f7d485d admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:56.885389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48b7613-b3fe-4d75-9588-87cd0f7d485d admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:56.886219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b7613-b3fe-4d75-9588-87cd0f7d485d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:56.887931 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48b7613-b3fe-4d75-9588-87cd0f7d485d admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:56.900939 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1410/2800] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:44:56.908142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2672e0f-e05f-4bbb-a2f0-99542a11867e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:56.920597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2672e0f-e05f-4bbb-a2f0-99542a11867e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:56.927186 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e581f7-d5ab-415f-9294-477f4af65a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:56.928607 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e581f7-d5ab-415f-9294-477f4af65a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:56.929116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e581f7-d5ab-415f-9294-477f4af65a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:56.929638 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e581f7-d5ab-415f-9294-477f4af65a5d admin admin] PATH_INFO: `/v3/projects/ce3e8f3592894606afc4d35c82d8f36f/users/b003492ec6a8434fb778f017b07e8697/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:56.949494 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e581f7-d5ab-415f-9294-477f4af65a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce3e8f3592894606afc4d35c82d8f36f, user_id=b003492ec6a8434fb778f017b07e8697, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:56.952116 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e581f7-d5ab-415f-9294-477f4af65a5d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:57.017830 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1391/2801] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:44:56 2022] PUT /identity/v3/projects/ce3e8f3592894606afc4d35c82d8f36f/users/b003492ec6a8434fb778f017b07e8697/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:57.023315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199cd71-ba70-470b-812f-870586ccd0c1 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:57.023730 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199cd71-ba70-470b-812f-870586ccd0c1 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:57.024585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199cd71-ba70-470b-812f-870586ccd0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:57.045972 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0199cd71-ba70-470b-812f-870586ccd0c1 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:57.047208 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0199cd71-ba70-470b-812f-870586ccd0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:57.142905 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1411/2802] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:44:57.154295 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e581f7-d5ab-415f-9294-477f4af65a5d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:57.156982 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a6e581f7-d5ab-415f-9294-477f4af65a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:57.254602 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e581f7-d5ab-415f-9294-477f4af65a5d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:57.259178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da858c-6695-45c0-86b9-8af047755824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:57.259890 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da858c-6695-45c0-86b9-8af047755824 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:57.260217 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da858c-6695-45c0-86b9-8af047755824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:57.260515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da858c-6695-45c0-86b9-8af047755824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:57.271393 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da858c-6695-45c0-86b9-8af047755824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:57.272802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da858c-6695-45c0-86b9-8af047755824 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:57.284847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1392/2803] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:58.277099 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199cd71-ba70-470b-812f-870586ccd0c1 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:58.279273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0199cd71-ba70-470b-812f-870586ccd0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:58.304006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199cd71-ba70-470b-812f-870586ccd0c1 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:58.315439 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:58.316452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:58.316853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:58.317332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] PATH_INFO: `/v3/users/28c3bb7463bc45bca91ec33458f65e67` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:58.318710 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c3bb7463bc45bca91ec33458f65e67)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:58.321310 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:58.514807 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:58.525182 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c3bb7463bc45bca91ec33458f65e67'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:58.543525 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c3bb7463bc45bca91ec33458f65e67'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:58.600919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c3bb7463bc45bca91ec33458f65e67'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:58.601512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c3bb7463bc45bca91ec33458f65e67'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:58.602560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c3bb7463bc45bca91ec33458f65e67'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:44:58.633511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1412/2804] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:44:58 2022] DELETE /identity/v3/users/28c3bb7463bc45bca91ec33458f65e67 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:44:58.638486 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60300f6d-63f3-47b1-8f00-b3054e9f8338 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:58.638910 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60300f6d-63f3-47b1-8f00-b3054e9f8338 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:58.639057 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60300f6d-63f3-47b1-8f00-b3054e9f8338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:58.661311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-60300f6d-63f3-47b1-8f00-b3054e9f8338 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:58.662820 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-60300f6d-63f3-47b1-8f00-b3054e9f8338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:58.782319 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1393/2805] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:44:58.793468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:58.795027 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:58.881047 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ffee75-7f3a-4ef8-a72c-c6e431166140 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:58.889435 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11855-2c6e-4056-929e-d4b1bce0606a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:58.890187 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11855-2c6e-4056-929e-d4b1bce0606a service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:58.890520 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11855-2c6e-4056-929e-d4b1bce0606a service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:58.890843 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11855-2c6e-4056-929e-d4b1bce0606a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:58.901675 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba11855-2c6e-4056-929e-d4b1bce0606a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:44:58.905012 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba11855-2c6e-4056-929e-d4b1bce0606a service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:44:58.920889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1413/2806] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:44:59.867052 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b810-5e23-499c-94b8-f0dc5ff85c16 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:59.867569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b810-5e23-499c-94b8-f0dc5ff85c16 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:59.867569 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33b810-5e23-499c-94b8-f0dc5ff85c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:59.899698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-3f33b810-5e23-499c-94b8-f0dc5ff85c16 None None] MFA Rules not processed for user `d3d92c0c69cf470e8aecb57e79e5a7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:44:59.900975 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3f33b810-5e23-499c-94b8-f0dc5ff85c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:59.939583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11855-2c6e-4056-929e-d4b1bce0606a service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:44:59.941226 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-2ba11855-2c6e-4056-929e-d4b1bce0606a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:44:59.980554 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11855-2c6e-4056-929e-d4b1bce0606a service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:44:59.995332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:44:59.996222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:44:59.996546 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:44:59.996806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] PATH_INFO: `/v3/projects/7378e9dcb47245fe83769d4f22639744` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:44:59.998958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=7378e9dcb47245fe83769d4f22639744)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:00.004757 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:00.067819 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1394/2807] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:44:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:45:00.071964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33b810-5e23-499c-94b8-f0dc5ff85c16 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:00.073676 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3f33b810-5e23-499c-94b8-f0dc5ff85c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:00.089227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33b810-5e23-499c-94b8-f0dc5ff85c16 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:00.096344 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86ce7-b2f1-4929-ac28-5dac30e5db15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:00.099579 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86ce7-b2f1-4929-ac28-5dac30e5db15 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:00.100203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86ce7-b2f1-4929-ac28-5dac30e5db15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:00.100804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c86ce7-b2f1-4929-ac28-5dac30e5db15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:00.102727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86ce7-b2f1-4929-ac28-5dac30e5db15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:00.106178 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c86ce7-b2f1-4929-ac28-5dac30e5db15 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:00.111991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:00.283199 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1395/2808] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:45:00 2022] POST /identity/v3/projects => generated 379 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:45:00.287644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86ce7-b2f1-4929-ac28-5dac30e5db15 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:00.317282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7378e9dcb47245fe83769d4f22639744', 'request_id': 'req-264de321-724c-4ef0-b88e-843d8eb826cd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:00.330574 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7378e9dcb47245fe83769d4f22639744', 'request_id': 'req-264de321-724c-4ef0-b88e-843d8eb826cd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:00.346595 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7378e9dcb47245fe83769d4f22639744', 'request_id': 'req-264de321-724c-4ef0-b88e-843d8eb826cd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:00.405275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c86ce7-b2f1-4929-ac28-5dac30e5db15 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:00.414703 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925a751-e96d-4901-96b9-e7f3104cc4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:00.415427 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925a751-e96d-4901-96b9-e7f3104cc4da admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:00.415717 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925a751-e96d-4901-96b9-e7f3104cc4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:00.415999 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925a751-e96d-4901-96b9-e7f3104cc4da admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:00.416761 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925a751-e96d-4901-96b9-e7f3104cc4da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:00.418931 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925a751-e96d-4901-96b9-e7f3104cc4da admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:00.459919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] The token cache is being invalidate because project 7378e9dcb47245fe83769d4f22639744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:45:00.459919 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:00.460564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:00.463309 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1414/2809] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:44:59 2022] DELETE /identity/v3/projects/7378e9dcb47245fe83769d4f22639744 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:00.468928 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:00.470484 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:00.518522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1396/2810] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:45:00 2022] POST /identity/v3/users => generated 296 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:45:00.519963 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925a751-e96d-4901-96b9-e7f3104cc4da admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:00.522947 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e925a751-e96d-4901-96b9-e7f3104cc4da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:00.530367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:00.552893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925a751-e96d-4901-96b9-e7f3104cc4da admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:00.560112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733b7ca-c5bc-43f6-be34-dd2b4f81985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:00.561403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733b7ca-c5bc-43f6-be34-dd2b4f81985e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:00.561403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733b7ca-c5bc-43f6-be34-dd2b4f81985e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:00.561589 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a733b7ca-c5bc-43f6-be34-dd2b4f81985e admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:00.562170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733b7ca-c5bc-43f6-be34-dd2b4f81985e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:00.562637 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264de321-724c-4ef0-b88e-843d8eb826cd admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:00.565360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a733b7ca-c5bc-43f6-be34-dd2b4f81985e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:00.568853 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:00.570427 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:00.570641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:00.571039 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] PATH_INFO: `/v3/users/d002bc49851a404ca691cabd24e873ed` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:00.572511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d002bc49851a404ca691cabd24e873ed)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:00.575911 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:00.598720 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1397/2811] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:45:00.603928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733b7ca-c5bc-43f6-be34-dd2b4f81985e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:00.638855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a733b7ca-c5bc-43f6-be34-dd2b4f81985e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:00.656760 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95117d29-a08c-4358-aa41-278ea52e6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:00.657698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95117d29-a08c-4358-aa41-278ea52e6a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:00.658111 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95117d29-a08c-4358-aa41-278ea52e6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:00.658430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95117d29-a08c-4358-aa41-278ea52e6a39 admin admin] PATH_INFO: `/v3/projects/3240aa60382e493c9171f7011771816c/users/19f566f40ef94e64a5c19a7a93dae2cb/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:00.678932 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95117d29-a08c-4358-aa41-278ea52e6a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3240aa60382e493c9171f7011771816c, user_id=19f566f40ef94e64a5c19a7a93dae2cb, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:00.684661 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95117d29-a08c-4358-aa41-278ea52e6a39 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:00.813668 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1398/2812] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:45:00 2022] PUT /identity/v3/projects/3240aa60382e493c9171f7011771816c/users/19f566f40ef94e64a5c19a7a93dae2cb/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:00.824353 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95117d29-a08c-4358-aa41-278ea52e6a39 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:00.845796 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd002bc49851a404ca691cabd24e873ed'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:00.880109 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd002bc49851a404ca691cabd24e873ed'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:00.964894 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95117d29-a08c-4358-aa41-278ea52e6a39 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:00.973483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc157a-0c2f-4cb8-9ed0-5e7b4f4b7bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:00.973483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc157a-0c2f-4cb8-9ed0-5e7b4f4b7bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:00.973483 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc157a-0c2f-4cb8-9ed0-5e7b4f4b7bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:00.973892 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedc157a-0c2f-4cb8-9ed0-5e7b4f4b7bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:00.974809 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc157a-0c2f-4cb8-9ed0-5e7b4f4b7bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:00.976779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedc157a-0c2f-4cb8-9ed0-5e7b4f4b7bf8 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:00.993608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1399/2813] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:45:00 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:45:00.998206 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc157a-0c2f-4cb8-9ed0-5e7b4f4b7bf8 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:00.999868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd002bc49851a404ca691cabd24e873ed'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:01.001315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd002bc49851a404ca691cabd24e873ed'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:01.002324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd002bc49851a404ca691cabd24e873ed'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:01.022793 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedc157a-0c2f-4cb8-9ed0-5e7b4f4b7bf8 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:01.030495 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508c83-a8fa-4518-98aa-fa1810e46c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:01.031504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508c83-a8fa-4518-98aa-fa1810e46c5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:01.031800 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508c83-a8fa-4518-98aa-fa1810e46c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:01.032082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c508c83-a8fa-4518-98aa-fa1810e46c5d admin admin] PATH_INFO: `/v3/projects/3240aa60382e493c9171f7011771816c/users/19f566f40ef94e64a5c19a7a93dae2cb/roles/7c09d078126441909df0a46212ffea63` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:01.032297 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1415/2814] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:45:00 2022] DELETE /identity/v3/users/d002bc49851a404ca691cabd24e873ed => generated 0 bytes in 564 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:01.037504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c508c83-a8fa-4518-98aa-fa1810e46c5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3240aa60382e493c9171f7011771816c, user_id=19f566f40ef94e64a5c19a7a93dae2cb, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:01.040803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c508c83-a8fa-4518-98aa-fa1810e46c5d admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:01.060301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1400/2815] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:45:00 2022] PUT /identity/v3/projects/3240aa60382e493c9171f7011771816c/users/19f566f40ef94e64a5c19a7a93dae2cb/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:45:01.561587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:01.563783 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:01.661389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa27c2-a2d1-4f96-846e-c9e7a2495946 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:01.734823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:01.735856 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:01.736653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:01.736653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] PATH_INFO: `/v3/projects/f2651b50abe9449da8257f9bf2155ad9` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:01.738179 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2651b50abe9449da8257f9bf2155ad9)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:01.740332 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:01.910369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2651b50abe9449da8257f9bf2155ad9', 'request_id': 'req-7e1a9389-19cc-4769-8e62-2e3ba0aca037'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:01.925245 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2651b50abe9449da8257f9bf2155ad9', 'request_id': 'req-7e1a9389-19cc-4769-8e62-2e3ba0aca037'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:01.927548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2651b50abe9449da8257f9bf2155ad9', 'request_id': 'req-7e1a9389-19cc-4769-8e62-2e3ba0aca037'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:02.024118 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] The token cache is being invalidate because project f2651b50abe9449da8257f9bf2155ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:45:02.026489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:02.026489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:02.036365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1416/2816] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:45:01 2022] DELETE /identity/v3/projects/f2651b50abe9449da8257f9bf2155ad9 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:02.037522 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508c83-a8fa-4518-98aa-fa1810e46c5d admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:02.039723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5c508c83-a8fa-4518-98aa-fa1810e46c5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:02.065430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c508c83-a8fa-4518-98aa-fa1810e46c5d admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:02.128970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:02.177537 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:02.179567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:02.179567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:02.179567 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] PATH_INFO: `/v3/users/3af342db45364b5b82e37db1409c427c` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:02.180801 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3af342db45364b5b82e37db1409c427c)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:02.182868 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:02.233668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:02.488119 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3af342db45364b5b82e37db1409c427c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:02.504000 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3af342db45364b5b82e37db1409c427c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:02.505853 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3af342db45364b5b82e37db1409c427c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:02.543750 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3af342db45364b5b82e37db1409c427c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:02.545350 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-210869bb-a2c5-4e00-9d9e-d02db323613c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3af342db45364b5b82e37db1409c427c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:02.692843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1401/2817] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:45:02 2022] DELETE /identity/v3/users/3af342db45364b5b82e37db1409c427c => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:45:03.744764 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:03.759828 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a9389-19cc-4769-8e62-2e3ba0aca037 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:03.847993 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:03.849192 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:03.849636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:03.851295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] PATH_INFO: `/v3/projects/03a2275df9f9475da125df51fbfcb63c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:03.853355 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a2275df9f9475da125df51fbfcb63c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:03.855529 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:04.017078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a2275df9f9475da125df51fbfcb63c', 'request_id': 'req-843e9f80-941e-400f-8823-18418d24130b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:04.033950 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a2275df9f9475da125df51fbfcb63c', 'request_id': 'req-843e9f80-941e-400f-8823-18418d24130b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:04.041901 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a2275df9f9475da125df51fbfcb63c', 'request_id': 'req-843e9f80-941e-400f-8823-18418d24130b'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:04.097717 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] The token cache is being invalidate because project 03a2275df9f9475da125df51fbfcb63c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:45:04.098006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:04.098965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-843e9f80-941e-400f-8823-18418d24130b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:04.100834 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1417/2818] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:45:03 2022] DELETE /identity/v3/projects/03a2275df9f9475da125df51fbfcb63c => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:04.107208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eff23-7602-4190-b83a-3818b620c6a5 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:04.108033 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eff23-7602-4190-b83a-3818b620c6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:04.108492 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11eff23-7602-4190-b83a-3818b620c6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:04.132854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-e11eff23-7602-4190-b83a-3818b620c6a5 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:04.132854 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-e11eff23-7602-4190-b83a-3818b620c6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:04.221994 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1402/2819] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:04.231050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f8878-af63-448a-8a75-ebcf67aef1a4 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:04.232633 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f8878-af63-448a-8a75-ebcf67aef1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:04.233008 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f8878-af63-448a-8a75-ebcf67aef1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:04.257150 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-822f8878-af63-448a-8a75-ebcf67aef1a4 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:04.259798 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-822f8878-af63-448a-8a75-ebcf67aef1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:04.275162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1418/2820] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:04.275360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eff23-7602-4190-b83a-3818b620c6a5 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:04.290460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11eff23-7602-4190-b83a-3818b620c6a5 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:04.297834 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8bbb-5d42-4d41-80de-535993fe6df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:04.298526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8bbb-5d42-4d41-80de-535993fe6df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:04.298812 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8bbb-5d42-4d41-80de-535993fe6df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:04.299980 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf8bbb-5d42-4d41-80de-535993fe6df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:04.301326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf8bbb-5d42-4d41-80de-535993fe6df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80335) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:45:04.301643 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf8bbb-5d42-4d41-80de-535993fe6df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:04.303304 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf8bbb-5d42-4d41-80de-535993fe6df2 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:04.359792 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1403/2821] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:45:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:45:04.363647 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f8878-af63-448a-8a75-ebcf67aef1a4 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:04.386058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f8878-af63-448a-8a75-ebcf67aef1a4 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:04.391969 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34f264-e93e-4ae2-a1d9-4f535bed3777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:04.393326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f264-e93e-4ae2-a1d9-4f535bed3777 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:04.393867 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f264-e93e-4ae2-a1d9-4f535bed3777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:04.394358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34f264-e93e-4ae2-a1d9-4f535bed3777 admin admin] PATH_INFO: `/v3/projects` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:04.395410 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34f264-e93e-4ae2-a1d9-4f535bed3777 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:04.397721 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34f264-e93e-4ae2-a1d9-4f535bed3777 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:04.415403 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:04.548307 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1419/2822] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:45:04 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:45:04.552368 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8bbb-5d42-4d41-80de-535993fe6df2 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:04.567928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf8bbb-5d42-4d41-80de-535993fe6df2 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:04.624010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:04.690458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa15c8b-90a8-4d7d-a86a-cdc41fac3254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:04.691151 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15c8b-90a8-4d7d-a86a-cdc41fac3254 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:04.691431 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15c8b-90a8-4d7d-a86a-cdc41fac3254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:04.691702 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15c8b-90a8-4d7d-a86a-cdc41fac3254 admin admin] PATH_INFO: `/v3/users` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:04.692405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa15c8b-90a8-4d7d-a86a-cdc41fac3254 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:04.694355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa15c8b-90a8-4d7d-a86a-cdc41fac3254 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:04.828037 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1404/2823] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:45:04 2022] POST /identity/v3/users => generated 285 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:45:04.832317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34f264-e93e-4ae2-a1d9-4f535bed3777 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:04.846585 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34f264-e93e-4ae2-a1d9-4f535bed3777 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:04.862216 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340665ea-73f2-4028-9296-3f385218399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:04.863074 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340665ea-73f2-4028-9296-3f385218399a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:04.863361 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340665ea-73f2-4028-9296-3f385218399a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:04.863641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340665ea-73f2-4028-9296-3f385218399a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:04.864379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340665ea-73f2-4028-9296-3f385218399a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:04.866324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340665ea-73f2-4028-9296-3f385218399a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:04.896649 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1420/2824] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:45:04.901822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa15c8b-90a8-4d7d-a86a-cdc41fac3254 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:04.918883 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa15c8b-90a8-4d7d-a86a-cdc41fac3254 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:04.934335 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f7ed8-572a-4c33-90fc-da000060147b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:04.935032 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f7ed8-572a-4c33-90fc-da000060147b admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:04.935324 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f7ed8-572a-4c33-90fc-da000060147b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:04.935603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f7ed8-572a-4c33-90fc-da000060147b admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:04.936349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f7ed8-572a-4c33-90fc-da000060147b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:04.938039 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5f7ed8-572a-4c33-90fc-da000060147b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:04.953833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1405/2825] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:45:04.955836 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340665ea-73f2-4028-9296-3f385218399a admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:04.974908 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340665ea-73f2-4028-9296-3f385218399a admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:04.991547 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4b992-b76a-4e9f-a7a3-f3b77a340037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:04.993315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4b992-b76a-4e9f-a7a3-f3b77a340037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:04.997918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4b992-b76a-4e9f-a7a3-f3b77a340037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:04.997918 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4b992-b76a-4e9f-a7a3-f3b77a340037 admin admin] PATH_INFO: `/v3/projects/bcaf53157d8f42d3874c96ae7d688550/users/fe1ad6a754b94d2b8e3d1145598f20f2/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:05.022937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4b992-b76a-4e9f-a7a3-f3b77a340037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcaf53157d8f42d3874c96ae7d688550, user_id=fe1ad6a754b94d2b8e3d1145598f20f2, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:05.026778 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4b992-b76a-4e9f-a7a3-f3b77a340037 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:05.118122 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c4d11-c3f3-46ca-9830-b3f3e6360ed8 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:05.118632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c4d11-c3f3-46ca-9830-b3f3e6360ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:05.118716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c4d11-c3f3-46ca-9830-b3f3e6360ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:05.135148 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1421/2826] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:45:04 2022] PUT /identity/v3/projects/bcaf53157d8f42d3874c96ae7d688550/users/fe1ad6a754b94d2b8e3d1145598f20f2/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:05.150048 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bd495-3ea2-4818-a819-8da6d6bf2f82 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:05.150334 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bd495-3ea2-4818-a819-8da6d6bf2f82 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:05.150610 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87bd495-3ea2-4818-a819-8da6d6bf2f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:05.166257 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-359c4d11-c3f3-46ca-9830-b3f3e6360ed8 None None] MFA Rules not processed for user `b003492ec6a8434fb778f017b07e8697`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:05.167966 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-359c4d11-c3f3-46ca-9830-b3f3e6360ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:05.195152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-f87bd495-3ea2-4818-a819-8da6d6bf2f82 None None] MFA Rules not processed for user `fe1ad6a754b94d2b8e3d1145598f20f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:05.197222 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f87bd495-3ea2-4818-a819-8da6d6bf2f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:05.297016 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1406/2827] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:45:05.298563 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c4d11-c3f3-46ca-9830-b3f3e6360ed8 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:05.300573 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-359c4d11-c3f3-46ca-9830-b3f3e6360ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:05.322303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1422/2828] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:05 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:05.341119 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bd495-3ea2-4818-a819-8da6d6bf2f82 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:05.344162 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-f87bd495-3ea2-4818-a819-8da6d6bf2f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:05.436242 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c4d11-c3f3-46ca-9830-b3f3e6360ed8 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:05.443404 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d5782-0ff1-4737-8293-d3a162d9fc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:05.444623 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d5782-0ff1-4737-8293-d3a162d9fc2b admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:05.444944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d5782-0ff1-4737-8293-d3a162d9fc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:05.446484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d5782-0ff1-4737-8293-d3a162d9fc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:05.451208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d5782-0ff1-4737-8293-d3a162d9fc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:05.453835 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73d5782-0ff1-4737-8293-d3a162d9fc2b admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:05.497907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87bd495-3ea2-4818-a819-8da6d6bf2f82 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:05.512587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393268e-eeee-484a-b844-00cf4e1330fa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451754f5553e4b9783b4e75f6d408ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:05.513808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393268e-eeee-484a-b844-00cf4e1330fa service glance] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:05.514779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393268e-eeee-484a-b844-00cf4e1330fa service glance] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:05.515257 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393268e-eeee-484a-b844-00cf4e1330fa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:05.529720 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393268e-eeee-484a-b844-00cf4e1330fa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:05.531835 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393268e-eeee-484a-b844-00cf4e1330fa service glance] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:05.546761 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1423/2829] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:45:05 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:45:05.570041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1407/2830] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:45:05 2022] POST /identity/v3/projects => generated 385 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:45:05.575354 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393268e-eeee-484a-b844-00cf4e1330fa service glance] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:05.668965 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393268e-eeee-484a-b844-00cf4e1330fa service glance] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:05.713102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c4db-643e-4716-9892-bc4dd081f520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:05.713831 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c4db-643e-4716-9892-bc4dd081f520 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:05.714111 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c4db-643e-4716-9892-bc4dd081f520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:05.714388 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a889c4db-643e-4716-9892-bc4dd081f520 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:05.715078 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889c4db-643e-4716-9892-bc4dd081f520 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:05.717314 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a889c4db-643e-4716-9892-bc4dd081f520 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:05.821995 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:05.829256 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1424/2831] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:45:05 2022] POST /identity/v3/users => generated 299 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:45:05.832817 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d5782-0ff1-4737-8293-d3a162d9fc2b admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:05.846969 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d5782-0ff1-4737-8293-d3a162d9fc2b admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:05.863325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2b2f-15cc-48e3-9c1b-452a205a9e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:05.864359 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2b2f-15cc-48e3-9c1b-452a205a9e3e admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:05.865053 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2b2f-15cc-48e3-9c1b-452a205a9e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:05.866112 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d2b2f-15cc-48e3-9c1b-452a205a9e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:05.867330 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d2b2f-15cc-48e3-9c1b-452a205a9e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:05.869461 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d2b2f-15cc-48e3-9c1b-452a205a9e3e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:05.884804 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1408/2832] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:45:05 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:45:05.889228 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c4db-643e-4716-9892-bc4dd081f520 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:05.902022 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a889c4db-643e-4716-9892-bc4dd081f520 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:05.908705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c245f-1f65-4ed8-9255-af718a3c9993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:05.910188 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c245f-1f65-4ed8-9255-af718a3c9993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:05.910698 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c245f-1f65-4ed8-9255-af718a3c9993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:05.911209 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c245f-1f65-4ed8-9255-af718a3c9993 admin admin] PATH_INFO: `/v3/projects/b92f2d9f77e046029d4b37ff2c4c8251/users/c3f4b70c1147409a9ba7ac8d8a0257ed/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:05.933999 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c245f-1f65-4ed8-9255-af718a3c9993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92f2d9f77e046029d4b37ff2c4c8251, user_id=c3f4b70c1147409a9ba7ac8d8a0257ed, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:05.938324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705c245f-1f65-4ed8-9255-af718a3c9993 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:06.028183 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1425/2833] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:45:05 2022] PUT /identity/v3/projects/b92f2d9f77e046029d4b37ff2c4c8251/users/c3f4b70c1147409a9ba7ac8d8a0257ed/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:45:06.028318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2b2f-15cc-48e3-9c1b-452a205a9e3e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:06.058298 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d2b2f-15cc-48e3-9c1b-452a205a9e3e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:06.076898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:06.204010 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4feb6-d8e9-4a1f-817a-e89c61779547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:06.205539 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4feb6-d8e9-4a1f-817a-e89c61779547 admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:06.206028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4feb6-d8e9-4a1f-817a-e89c61779547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:06.206591 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4feb6-d8e9-4a1f-817a-e89c61779547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:06.207551 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4feb6-d8e9-4a1f-817a-e89c61779547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:06.209426 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4feb6-d8e9-4a1f-817a-e89c61779547 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:06.224464 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1409/2834] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:45:06 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:45:06.231933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c245f-1f65-4ed8-9255-af718a3c9993 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:06.275949 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c245f-1f65-4ed8-9255-af718a3c9993 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:06.296199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b8e56-6100-41c8-924c-b0ccda774c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:06.299502 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b8e56-6100-41c8-924c-b0ccda774c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:06.299987 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b8e56-6100-41c8-924c-b0ccda774c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:06.300453 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b8e56-6100-41c8-924c-b0ccda774c19 admin admin] PATH_INFO: `/v3/projects/b92f2d9f77e046029d4b37ff2c4c8251/users/c3f4b70c1147409a9ba7ac8d8a0257ed/roles/7c09d078126441909df0a46212ffea63` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:06.307808 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b8e56-6100-41c8-924c-b0ccda774c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92f2d9f77e046029d4b37ff2c4c8251, user_id=c3f4b70c1147409a9ba7ac8d8a0257ed, role_id=7c09d078126441909df0a46212ffea63)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:06.312137 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43b8e56-6100-41c8-924c-b0ccda774c19 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:06.325422 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1426/2835] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:45:06 2022] PUT /identity/v3/projects/b92f2d9f77e046029d4b37ff2c4c8251/users/c3f4b70c1147409a9ba7ac8d8a0257ed/roles/7c09d078126441909df0a46212ffea63 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:10.100827 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e186d0f-d977-4b57-ad55-bbc61e4e8b65 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:10.101299 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e186d0f-d977-4b57-ad55-bbc61e4e8b65 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:10.101700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e186d0f-d977-4b57-ad55-bbc61e4e8b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:10.138619 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-5e186d0f-d977-4b57-ad55-bbc61e4e8b65 None None] MFA Rules not processed for user `19f566f40ef94e64a5c19a7a93dae2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:10.142415 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-5e186d0f-d977-4b57-ad55-bbc61e4e8b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:10.298349 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1410/2836] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:10 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:10.315657 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b8e56-6100-41c8-924c-b0ccda774c19 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:10.322678 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a43b8e56-6100-41c8-924c-b0ccda774c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:10.485562 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43b8e56-6100-41c8-924c-b0ccda774c19 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:10.501915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a79dd-ff00-49fd-8b4b-6667f050cbfe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:10.503142 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a79dd-ff00-49fd-8b4b-6667f050cbfe service nova] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:10.503528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a79dd-ff00-49fd-8b4b-6667f050cbfe service nova] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:10.503904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a79dd-ff00-49fd-8b4b-6667f050cbfe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:10.507511 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-211a79dd-ff00-49fd-8b4b-6667f050cbfe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:10.588512 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a79dd-ff00-49fd-8b4b-6667f050cbfe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:10.590705 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a79dd-ff00-49fd-8b4b-6667f050cbfe service nova] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:10.613006 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1427/2837] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:45:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:45:13.912697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7f96-a058-454b-a6b9-e014a938c543 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:13.913173 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7f96-a058-454b-a6b9-e014a938c543 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:13.913301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dd7f96-a058-454b-a6b9-e014a938c543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:13.941649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-86dd7f96-a058-454b-a6b9-e014a938c543 None None] MFA Rules not processed for user `c3f4b70c1147409a9ba7ac8d8a0257ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:13.942821 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-86dd7f96-a058-454b-a6b9-e014a938c543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:14.051502 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1411/2838] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:13 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:14.071806 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a79dd-ff00-49fd-8b4b-6667f050cbfe service nova] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:14.143367 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:14.154846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a79dd-ff00-49fd-8b4b-6667f050cbfe service nova] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:14.158517 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33071-444d-48d7-b299-e8cc4b31b277 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '451754f5553e4b9783b4e75f6d408ab6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:14.159158 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33071-444d-48d7-b299-e8cc4b31b277 service glance] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:14.159437 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33071-444d-48d7-b299-e8cc4b31b277 service glance] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:14.159707 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a33071-444d-48d7-b299-e8cc4b31b277 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:14.234563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a33071-444d-48d7-b299-e8cc4b31b277 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:14.236060 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a33071-444d-48d7-b299-e8cc4b31b277 service glance] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:14.247942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1428/2839] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:45:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:45:14.531051 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74cdd-f8ee-4fca-a0c3-b7e19e8124b7 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:14.531465 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74cdd-f8ee-4fca-a0c3-b7e19e8124b7 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:14.531843 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d74cdd-f8ee-4fca-a0c3-b7e19e8124b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:14.600865 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-86d74cdd-f8ee-4fca-a0c3-b7e19e8124b7 None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:14.602666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-86d74cdd-f8ee-4fca-a0c3-b7e19e8124b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:14.630441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:14.687345 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1412/2840] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:45:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:14.804289 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33071-444d-48d7-b299-e8cc4b31b277 service glance] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:14.806466 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-17a33071-444d-48d7-b299-e8cc4b31b277 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:14.888494 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a33071-444d-48d7-b299-e8cc4b31b277 service glance] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:14.894035 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6503edcb-3ab7-41be-ae92-1db0de54eccc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:14.895473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503edcb-3ab7-41be-ae92-1db0de54eccc service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:14.895473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503edcb-3ab7-41be-ae92-1db0de54eccc service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:14.895473 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6503edcb-3ab7-41be-ae92-1db0de54eccc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:14.908407 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503edcb-3ab7-41be-ae92-1db0de54eccc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:14.910383 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6503edcb-3ab7-41be-ae92-1db0de54eccc service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:14.923855 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1429/2841] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:45:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:45:24.916169 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=61 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:24.954381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=16 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:26.838453 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0390-a9df-42bb-a3d5-d025d7575050 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:26.839059 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0390-a9df-42bb-a3d5-d025d7575050 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:26.839059 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac0390-a9df-42bb-a3d5-d025d7575050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:26.859666 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4bac0390-a9df-42bb-a3d5-d025d7575050 None None] MFA Rules not processed for user `b003492ec6a8434fb778f017b07e8697`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:26.860916 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4bac0390-a9df-42bb-a3d5-d025d7575050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:26.868596 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1413/2842] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:33.458671 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38317-8fe8-45d7-937e-19d7ab0efa2e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:33.460851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38317-8fe8-45d7-937e-19d7ab0efa2e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:33.460851 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e38317-8fe8-45d7-937e-19d7ab0efa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:33.492083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-c4e38317-8fe8-45d7-937e-19d7ab0efa2e None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:33.493330 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c4e38317-8fe8-45d7-937e-19d7ab0efa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:33.507171 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1430/2843] 10.222.0.24 () {58 vars in 1009 bytes} [Wed May 25 07:45:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:33.519946 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac0390-a9df-42bb-a3d5-d025d7575050 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:33.533409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bac0390-a9df-42bb-a3d5-d025d7575050 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:33.538649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037260dd-4c7d-49b4-9ca9-fa91044ff3a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:33.539317 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037260dd-4c7d-49b4-9ca9-fa91044ff3a8 service swift] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:33.539599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037260dd-4c7d-49b4-9ca9-fa91044ff3a8 service swift] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:33.541197 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037260dd-4c7d-49b4-9ca9-fa91044ff3a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:33.555651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037260dd-4c7d-49b4-9ca9-fa91044ff3a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:33.558081 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037260dd-4c7d-49b4-9ca9-fa91044ff3a8 service swift] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:33.568795 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1414/2844] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:45:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:45:39.255817 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aa303-b748-47f0-94ec-03d30f2ea72e None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:39.256448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aa303-b748-47f0-94ec-03d30f2ea72e None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:39.256448 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4aa303-b748-47f0-94ec-03d30f2ea72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:39.278479 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-fa4aa303-b748-47f0-94ec-03d30f2ea72e None None] MFA Rules not processed for user `820809022ed4493eb9f536c3b1fbc878`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:39.279891 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-fa4aa303-b748-47f0-94ec-03d30f2ea72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:39.380524 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1431/2845] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:40.857785 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a78c28-dc37-4e38-832b-4bdd62e1fc03 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:40.858437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a78c28-dc37-4e38-832b-4bdd62e1fc03 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:40.858437 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a78c28-dc37-4e38-832b-4bdd62e1fc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:40.878574 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-96a78c28-dc37-4e38-832b-4bdd62e1fc03 None None] MFA Rules not processed for user `d3d92c0c69cf470e8aecb57e79e5a7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:40.879822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-96a78c28-dc37-4e38-832b-4bdd62e1fc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:40.886995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1415/2846] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:49.375457 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=28 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:50.872200 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=12 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:50.910252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aa303-b748-47f0-94ec-03d30f2ea72e None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:50.979258 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4aa303-b748-47f0-94ec-03d30f2ea72e None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:50.985083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:50.986173 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:50.986390 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:50.986669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] PATH_INFO: `/v3/users/fe1ad6a754b94d2b8e3d1145598f20f2` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:50.987898 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1ad6a754b94d2b8e3d1145598f20f2)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:50.989991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:51.186097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1ad6a754b94d2b8e3d1145598f20f2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:51.197640 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1ad6a754b94d2b8e3d1145598f20f2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:51.285612 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1ad6a754b94d2b8e3d1145598f20f2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:51.286320 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1ad6a754b94d2b8e3d1145598f20f2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:51.287054 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1ad6a754b94d2b8e3d1145598f20f2'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:51.303133 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1432/2847] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:45:50 2022] DELETE /identity/v3/users/fe1ad6a754b94d2b8e3d1145598f20f2 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:51.307612 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a50c-1957-421b-9436-11321427f505 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:51.307897 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a50c-1957-421b-9436-11321427f505 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:51.308169 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3a50c-1957-421b-9436-11321427f505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:51.327614 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-c4d3a50c-1957-421b-9436-11321427f505 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:51.328942 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c4d3a50c-1957-421b-9436-11321427f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:51.394472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1416/2848] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:45:51.410345 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:51.414782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:51.514904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278d4ed4-e1ee-4962-9239-01fea9d0a8d9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:51.519229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136a0405-10b3-4496-8408-f4675c164339 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:51.520108 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0405-10b3-4496-8408-f4675c164339 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:51.520535 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0405-10b3-4496-8408-f4675c164339 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:51.526285 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136a0405-10b3-4496-8408-f4675c164339 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:51.543937 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a0405-10b3-4496-8408-f4675c164339 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:51.546322 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136a0405-10b3-4496-8408-f4675c164339 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:51.559269 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1433/2849] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:45:52.115680 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a50c-1957-421b-9436-11321427f505 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:52.118117 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c4d3a50c-1957-421b-9436-11321427f505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:52.131325 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3a50c-1957-421b-9436-11321427f505 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:52.136024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:52.136915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:52.147063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:52.147063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] PATH_INFO: `/v3/projects/bcaf53157d8f42d3874c96ae7d688550` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:52.147063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcaf53157d8f42d3874c96ae7d688550)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:52.147063 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:52.303403 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcaf53157d8f42d3874c96ae7d688550', 'request_id': 'req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:52.309726 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcaf53157d8f42d3874c96ae7d688550', 'request_id': 'req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:52.315992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcaf53157d8f42d3874c96ae7d688550', 'request_id': 'req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:52.387492 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] The token cache is being invalidate because project bcaf53157d8f42d3874c96ae7d688550 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:45:52.387716 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:52.388360 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-d7bd6578-2771-4b1c-a511-08d5bcfa5b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:52.390256 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1417/2850] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:45:52 2022] DELETE /identity/v3/projects/bcaf53157d8f42d3874c96ae7d688550 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:52.395737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9d689-1934-4bf0-bcca-89621d4bd70c None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:52.396262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9d689-1934-4bf0-bcca-89621d4bd70c None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:52.396492 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee9d689-1934-4bf0-bcca-89621d4bd70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:52.414346 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-0ee9d689-1934-4bf0-bcca-89621d4bd70c None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:52.415703 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-0ee9d689-1934-4bf0-bcca-89621d4bd70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:52.433629 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:52.476143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1434/2851] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:52.485028 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad0482-8f97-4fc0-a13f-cc6ab4081d29 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:52.485409 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad0482-8f97-4fc0-a13f-cc6ab4081d29 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:52.485696 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad0482-8f97-4fc0-a13f-cc6ab4081d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:52.505311 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-40ad0482-8f97-4fc0-a13f-cc6ab4081d29 None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:52.506586 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-40ad0482-8f97-4fc0-a13f-cc6ab4081d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:52.514756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1418/2852] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:52.518980 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9d689-1934-4bf0-bcca-89621d4bd70c None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:52.528812 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee9d689-1934-4bf0-bcca-89621d4bd70c None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:52.533618 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9fd94-e465-414d-90ac-0199380a5664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:52.534262 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9fd94-e465-414d-90ac-0199380a5664 admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:52.534569 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9fd94-e465-414d-90ac-0199380a5664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:52.534840 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9fd94-e465-414d-90ac-0199380a5664 admin admin] PATH_INFO: `/v3/domains` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:52.535560 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9fd94-e465-414d-90ac-0199380a5664 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80334) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:45:52.535863 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9fd94-e465-414d-90ac-0199380a5664 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:52.537496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9fd94-e465-414d-90ac-0199380a5664 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:52.549693 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1435/2853] 10.222.0.24 () {58 vars in 1152 bytes} [Wed May 25 07:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:45:52.553837 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad0482-8f97-4fc0-a13f-cc6ab4081d29 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:52.563944 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad0482-8f97-4fc0-a13f-cc6ab4081d29 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:52.568727 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b0685-e9ba-48c3-bd35-75c15c7b7200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:52.569385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b0685-e9ba-48c3-bd35-75c15c7b7200 admin admin] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:52.569671 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b0685-e9ba-48c3-bd35-75c15c7b7200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:52.569951 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b0685-e9ba-48c3-bd35-75c15c7b7200 admin admin] PATH_INFO: `/v3/projects` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:52.570658 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b0685-e9ba-48c3-bd35-75c15c7b7200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:52.572590 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b0685-e9ba-48c3-bd35-75c15c7b7200 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:52.658725 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1419/2854] 10.222.0.24 () {60 vars in 1152 bytes} [Wed May 25 07:45:52 2022] POST /identity/v3/projects => generated 371 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:45:52.662811 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9fd94-e465-414d-90ac-0199380a5664 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:52.674290 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9fd94-e465-414d-90ac-0199380a5664 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:52.746536 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294441-4c7b-4ec9-92f0-3bfc6e047d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:52.747273 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294441-4c7b-4ec9-92f0-3bfc6e047d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:52.747503 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294441-4c7b-4ec9-92f0-3bfc6e047d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:52.747781 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294441-4c7b-4ec9-92f0-3bfc6e047d12 admin admin] PATH_INFO: `/v3/users` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:52.748718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294441-4c7b-4ec9-92f0-3bfc6e047d12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:52.751053 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49294441-4c7b-4ec9-92f0-3bfc6e047d12 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:52.843964 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1436/2855] 10.222.0.24 () {60 vars in 1143 bytes} [Wed May 25 07:45:52 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:45:52.845517 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b0685-e9ba-48c3-bd35-75c15c7b7200 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:52.863765 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b0685-e9ba-48c3-bd35-75c15c7b7200 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:52.869218 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb01fa-0762-49c2-93e1-4d7962df465f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:52.869889 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb01fa-0762-49c2-93e1-4d7962df465f admin admin] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:52.870174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb01fa-0762-49c2-93e1-4d7962df465f admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:52.870515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb01fa-0762-49c2-93e1-4d7962df465f admin admin] PATH_INFO: `/v3/roles` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:52.871243 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb01fa-0762-49c2-93e1-4d7962df465f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:52.875172 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb01fa-0762-49c2-93e1-4d7962df465f admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:52.887847 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1420/2856] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:45:52.900669 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294441-4c7b-4ec9-92f0-3bfc6e047d12 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:52.907389 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294441-4c7b-4ec9-92f0-3bfc6e047d12 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:52.912696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366d1ffe-fbc6-4fca-9cea-cc3e2b04bc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:52.913528 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d1ffe-fbc6-4fca-9cea-cc3e2b04bc0a admin admin] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:52.913718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d1ffe-fbc6-4fca-9cea-cc3e2b04bc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:52.914128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366d1ffe-fbc6-4fca-9cea-cc3e2b04bc0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:52.914583 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d1ffe-fbc6-4fca-9cea-cc3e2b04bc0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:52.916190 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366d1ffe-fbc6-4fca-9cea-cc3e2b04bc0a admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:52.928234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1437/2857] 10.222.0.24 () {58 vars in 1121 bytes} [Wed May 25 07:45:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:45:52.932565 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb01fa-0762-49c2-93e1-4d7962df465f admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:52.943245 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb01fa-0762-49c2-93e1-4d7962df465f admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:52.947934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25496-d0a3-48e9-9c71-db7b093272fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:52.948844 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25496-d0a3-48e9-9c71-db7b093272fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:52.949123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25496-d0a3-48e9-9c71-db7b093272fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:52.949394 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e25496-d0a3-48e9-9c71-db7b093272fe admin admin] PATH_INFO: `/v3/projects/0e6fe54c744742c8a6d930a5a00e8cec/users/3631f89662cf4b2b82667e55eabfc5fd/roles/511a27be33a74a7c996a7ca5261b55f6` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:52.969101 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e25496-d0a3-48e9-9c71-db7b093272fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e6fe54c744742c8a6d930a5a00e8cec, user_id=3631f89662cf4b2b82667e55eabfc5fd, role_id=511a27be33a74a7c996a7ca5261b55f6)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:52.971869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e25496-d0a3-48e9-9c71-db7b093272fe admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:53.069538 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1421/2858] 10.222.0.24 () {60 vars in 1482 bytes} [Wed May 25 07:45:52 2022] PUT /identity/v3/projects/0e6fe54c744742c8a6d930a5a00e8cec/users/3631f89662cf4b2b82667e55eabfc5fd/roles/511a27be33a74a7c996a7ca5261b55f6 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:45:53.080590 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e2767-f425-440d-bd57-05f77ffe9b33 None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:53.080882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e2767-f425-440d-bd57-05f77ffe9b33 None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:53.081204 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e2767-f425-440d-bd57-05f77ffe9b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:53.106956 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-170e2767-f425-440d-bd57-05f77ffe9b33 None None] MFA Rules not processed for user `3631f89662cf4b2b82667e55eabfc5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:53.108184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-170e2767-f425-440d-bd57-05f77ffe9b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:53.175069 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1438/2859] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:45:53.186970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25496-d0a3-48e9-9c71-db7b093272fe admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:53.188718 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-15e25496-d0a3-48e9-9c71-db7b093272fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:53.211506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:53.247060 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e25496-d0a3-48e9-9c71-db7b093272fe admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:53.251355 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ace61d-b4bf-43fe-bfec-7ecd8d5d7cbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:53.252001 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ace61d-b4bf-43fe-bfec-7ecd8d5d7cbc service cinder] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:53.252284 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ace61d-b4bf-43fe-bfec-7ecd8d5d7cbc service cinder] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:53.252588 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ace61d-b4bf-43fe-bfec-7ecd8d5d7cbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:53.261484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ace61d-b4bf-43fe-bfec-7ecd8d5d7cbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:53.263002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ace61d-b4bf-43fe-bfec-7ecd8d5d7cbc service cinder] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:53.273079 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1422/2860] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:45:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:45:53.299782 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e2767-f425-440d-bd57-05f77ffe9b33 None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:53.320096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:53.367062 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e2767-f425-440d-bd57-05f77ffe9b33 None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:53.372126 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:53.372896 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:53.374335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:53.374335 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] PATH_INFO: `/v3/users/3631f89662cf4b2b82667e55eabfc5fd` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:53.375327 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3631f89662cf4b2b82667e55eabfc5fd)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:53.377303 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:53.562889 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3631f89662cf4b2b82667e55eabfc5fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:53.574734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3631f89662cf4b2b82667e55eabfc5fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:53.633632 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3631f89662cf4b2b82667e55eabfc5fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:53.634272 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3631f89662cf4b2b82667e55eabfc5fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:53.634886 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3631f89662cf4b2b82667e55eabfc5fd'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:53.649089 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1439/2861] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:45:53 2022] DELETE /identity/v3/users/3631f89662cf4b2b82667e55eabfc5fd => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:45:53.653779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708415e-5555-4828-ab8b-669fc266eebd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:53.654067 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708415e-5555-4828-ab8b-669fc266eebd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:53.654396 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708415e-5555-4828-ab8b-669fc266eebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:53.672142 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-4708415e-5555-4828-ab8b-669fc266eebd None None] MFA Rules not processed for user `91002622404a49918bac736d37052f04`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:45:53.673608 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4708415e-5555-4828-ab8b-669fc266eebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:53.730784 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1423/2862] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:45:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:45:53.740927 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:53.742689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:53.803822 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3c1a9a-f97d-4f18-b2e4-e43439650d70 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:53.807460 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fb819-8395-4806-b8cb-b4715f99e961 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:53.808097 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fb819-8395-4806-b8cb-b4715f99e961 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:53.808379 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fb819-8395-4806-b8cb-b4715f99e961 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:53.808686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fb819-8395-4806-b8cb-b4715f99e961 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:53.817766 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fb819-8395-4806-b8cb-b4715f99e961 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:53.819174 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5fb819-8395-4806-b8cb-b4715f99e961 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:53.829059 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1440/2863] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:45:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:45:54.333339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708415e-5555-4828-ab8b-669fc266eebd None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:45:54.335484 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-4708415e-5555-4828-ab8b-669fc266eebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:45:54.350506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708415e-5555-4828-ab8b-669fc266eebd None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:45:54.355609 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:45:54.356526 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:45:54.356807 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:45:54.357086 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] PATH_INFO: `/v3/projects/0e6fe54c744742c8a6d930a5a00e8cec` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:45:54.358791 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e6fe54c744742c8a6d930a5a00e8cec)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:45:54.360757 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:45:54.470150 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e6fe54c744742c8a6d930a5a00e8cec', 'request_id': 'req-7d5f02b8-4e33-4553-a36c-666e0a05263e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:54.476309 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e6fe54c744742c8a6d930a5a00e8cec', 'request_id': 'req-7d5f02b8-4e33-4553-a36c-666e0a05263e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:54.482007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e6fe54c744742c8a6d930a5a00e8cec', 'request_id': 'req-7d5f02b8-4e33-4553-a36c-666e0a05263e'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:54.559260 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] The token cache is being invalidate because project 0e6fe54c744742c8a6d930a5a00e8cec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:45:54.559649 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:54.560512 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:45:54.562646 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1424/2864] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:45:54 2022] DELETE /identity/v3/projects/0e6fe54c744742c8a6d930a5a00e8cec => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:46:03.824416 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:04.556463 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:05.980692 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fb819-8395-4806-b8cb-b4715f99e961 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:46:05.982234 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-6f5fb819-8395-4806-b8cb-b4715f99e961 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:46:05.995058 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5fb819-8395-4806-b8cb-b4715f99e961 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:46:06.045495 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:46:06.046141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:46:06.046434 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:46:06.046694 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:46:06.048441 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:46:06.110779 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:46:06.112697 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:46:06.122729 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1441/2865] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:46:05 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:46:06.304290 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:46:06.305779 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:46:06.318133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f02b8-4e33-4553-a36c-666e0a05263e admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:46:06.321733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbdc2e-ca8b-40bb-ad61-4d5d0a878fcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:46:06.322385 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbdc2e-ca8b-40bb-ad61-4d5d0a878fcb service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:46:06.322670 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbdc2e-ca8b-40bb-ad61-4d5d0a878fcb service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:46:06.327331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbdc2e-ca8b-40bb-ad61-4d5d0a878fcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:46:06.327331 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-31bbdc2e-ca8b-40bb-ad61-4d5d0a878fcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:46:06.392234 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbdc2e-ca8b-40bb-ad61-4d5d0a878fcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:46:06.394501 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbdc2e-ca8b-40bb-ad61-4d5d0a878fcb service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:46:06.404577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1425/2866] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:46:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:46:16.118419 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=50 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:16.400091 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=30 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:30.084071 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:46:30.085548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:46:30.096115 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9742df71-daa5-48b3-9079-b6074e55b80e service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:46:30.099746 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:46:30.100564 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:46:30.100846 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:46:30.101114 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:46:30.102935 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:46:30.176044 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:46:30.178144 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:46:30.189672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1442/2867] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:46:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:46:35.733278 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbdc2e-ca8b-40bb-ad61-4d5d0a878fcb service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:46:35.741893 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbdc2e-ca8b-40bb-ad61-4d5d0a878fcb service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:46:35.746034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbf5e6-73aa-4a94-99c7-fd2ed9f0a473 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:46:35.746700 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf5e6-73aa-4a94-99c7-fd2ed9f0a473 service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:46:35.746983 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf5e6-73aa-4a94-99c7-fd2ed9f0a473 service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:46:35.747259 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fbf5e6-73aa-4a94-99c7-fd2ed9f0a473 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:46:35.749062 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-93fbf5e6-73aa-4a94-99c7-fd2ed9f0a473 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:46:35.763275 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbf5e6-73aa-4a94-99c7-fd2ed9f0a473 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:46:35.764774 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fbf5e6-73aa-4a94-99c7-fd2ed9f0a473 service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:46:35.776751 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1426/2868] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:46:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:46:40.184408 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=34 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:45.770869 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:59.006050 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:46:59.007496 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:46:59.071962 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189e1400-1600-4415-b4ec-83c676b64fb5 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:46:59.076461 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:46:59.077343 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:46:59.077628 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:46:59.077974 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] PATH_INFO: `/v3/users/820809022ed4493eb9f536c3b1fbc878` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:46:59.079288 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=820809022ed4493eb9f536c3b1fbc878)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:46:59.081230 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:46:59.268787 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '820809022ed4493eb9f536c3b1fbc878'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.280163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '820809022ed4493eb9f536c3b1fbc878'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.341670 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '820809022ed4493eb9f536c3b1fbc878'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.342313 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '820809022ed4493eb9f536c3b1fbc878'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.342933 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '820809022ed4493eb9f536c3b1fbc878'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.356214 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1443/2869] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:46:59 2022] DELETE /identity/v3/users/820809022ed4493eb9f536c3b1fbc878 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:46:59.606363 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbf5e6-73aa-4a94-99c7-fd2ed9f0a473 service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:46:59.619318 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fbf5e6-73aa-4a94-99c7-fd2ed9f0a473 service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:46:59.678967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:46:59.679833 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:46:59.680114 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:46:59.680391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] PATH_INFO: `/v3/projects/ee2590cbdba14e7ab1f3ce5a58beeb54` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:46:59.681864 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee2590cbdba14e7ab1f3ce5a58beeb54)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:46:59.683786 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:46:59.799246 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'request_id': 'req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.805337 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'request_id': 'req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.810733 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'request_id': 'req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.883950 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] The token cache is being invalidate because project ee2590cbdba14e7ab1f3ce5a58beeb54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80335) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:46:59.884175 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.884802 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-53385c18-f7a2-4b9b-ac85-e51e16b75d9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:46:59.886339 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1427/2870] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:46:59 2022] DELETE /identity/v3/projects/ee2590cbdba14e7ab1f3ce5a58beeb54 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:47:09.352659 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=53,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:09.880636 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:22.987163 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:47:22.988737 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:47:23.070868 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339991fe-2315-4065-99f7-eb99417a81cd admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:47:23.133034 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:47:23.133641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:47:23.133923 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:47:23.134199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:47:23.135991 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:47:23.146145 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:47:23.147587 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:47:23.160907 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1444/2871] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:47:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:47:33.152223 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=46 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:33.193088 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090ca6-3940-4a8f-9b23-2e2920e35032 None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:47:33.203391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090ca6-3940-4a8f-9b23-2e2920e35032 None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:47:33.203391 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090ca6-3940-4a8f-9b23-2e2920e35032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:47:33.211458 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-90090ca6-3940-4a8f-9b23-2e2920e35032 None None] MFA Rules not processed for user `442cda3fdb25400a8cdab1655717b1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:47:33.212698 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-90090ca6-3940-4a8f-9b23-2e2920e35032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:47:33.268268 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1428/2872] 10.222.0.24 () {58 vars in 967 bytes} [Wed May 25 07:47:33 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 07:47:33.309017 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:47:33.310478 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:47:33.379392 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024d2fa1-f45d-4d43-9cd1-868762a6ea69 service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:47:33.384369 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87a767-80ad-4a28-a7ef-cc7946b610b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b54767b9f07341c3aa2ba9a120a62ed0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:47:33.385040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87a767-80ad-4a28-a7ef-cc7946b610b1 service swift] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:47:33.385324 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87a767-80ad-4a28-a7ef-cc7946b610b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:47:33.385601 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87a767-80ad-4a28-a7ef-cc7946b610b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:47:33.393684 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87a767-80ad-4a28-a7ef-cc7946b610b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:47:33.395251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a87a767-80ad-4a28-a7ef-cc7946b610b1 service swift] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:47:33.403184 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1445/2873] 10.222.0.24 () {60 vars in 1384 bytes} [Wed May 25 07:47:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:47:41.621375 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90090ca6-3940-4a8f-9b23-2e2920e35032 None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:47:41.622825 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-90090ca6-3940-4a8f-9b23-2e2920e35032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:47:41.690208 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90090ca6-3940-4a8f-9b23-2e2920e35032 None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:47:41.694781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:47:41.695644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:47:41.695924 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:47:41.696193 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] PATH_INFO: `/v3/users/b003492ec6a8434fb778f017b07e8697` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:47:41.697450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b003492ec6a8434fb778f017b07e8697)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:47:41.699397 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:47:41.868041 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b003492ec6a8434fb778f017b07e8697'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:41.875094 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b003492ec6a8434fb778f017b07e8697'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:41.875767 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b003492ec6a8434fb778f017b07e8697'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:41.887762 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b003492ec6a8434fb778f017b07e8697'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:41.888395 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b003492ec6a8434fb778f017b07e8697'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:41.961970 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1429/2874] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:47:41 2022] DELETE /identity/v3/users/b003492ec6a8434fb778f017b07e8697 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:47:42.269701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87a767-80ad-4a28-a7ef-cc7946b610b1 service swift] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:47:42.285895 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87a767-80ad-4a28-a7ef-cc7946b610b1 service swift] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:47:42.348636 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:47:42.349622 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:47:42.349904 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:47:42.350180 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] PATH_INFO: `/v3/projects/ce3e8f3592894606afc4d35c82d8f36f` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:47:42.351366 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce3e8f3592894606afc4d35c82d8f36f)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:47:42.353329 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:47:42.463396 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce3e8f3592894606afc4d35c82d8f36f', 'request_id': 'req-34b9eafd-63ab-46de-812d-0f1a5acef9e9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.469699 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce3e8f3592894606afc4d35c82d8f36f', 'request_id': 'req-34b9eafd-63ab-46de-812d-0f1a5acef9e9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.475747 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce3e8f3592894606afc4d35c82d8f36f', 'request_id': 'req-34b9eafd-63ab-46de-812d-0f1a5acef9e9'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.519436 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] The token cache is being invalidate because project ce3e8f3592894606afc4d35c82d8f36f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:47:42.526954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.526954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.526954 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1446/2875] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:47:42 2022] DELETE /identity/v3/projects/ce3e8f3592894606afc4d35c82d8f36f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:47:42.527342 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:47:42.529174 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:47:42.542632 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08807f0-688c-415f-83ab-54ad8f9a22a5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:47:42.563073 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:42.604301 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:47:42.605215 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:47:42.605498 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:47:42.605803 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] PATH_INFO: `/v3/users/c3f4b70c1147409a9ba7ac8d8a0257ed` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:47:42.607034 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f4b70c1147409a9ba7ac8d8a0257ed)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:47:42.609097 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:47:42.827981 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f4b70c1147409a9ba7ac8d8a0257ed'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.834818 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f4b70c1147409a9ba7ac8d8a0257ed'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.835472 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f4b70c1147409a9ba7ac8d8a0257ed'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.847326 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f4b70c1147409a9ba7ac8d8a0257ed'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.847989 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f4b70c1147409a9ba7ac8d8a0257ed'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:42.950997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1430/2876] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:47:42 2022] DELETE /identity/v3/users/c3f4b70c1147409a9ba7ac8d8a0257ed => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:47:43.240238 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:47:43.241724 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:47:43.258827 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b9eafd-63ab-46de-812d-0f1a5acef9e9 admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:47:43.277143 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:43.318003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:47:43.318880 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:47:43.319161 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:47:43.319438 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] PATH_INFO: `/v3/projects/b92f2d9f77e046029d4b37ff2c4c8251` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:47:43.320682 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92f2d9f77e046029d4b37ff2c4c8251)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:47:43.322611 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:47:43.416086 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92f2d9f77e046029d4b37ff2c4c8251', 'request_id': 'req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:43.422251 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92f2d9f77e046029d4b37ff2c4c8251', 'request_id': 'req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:43.427985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92f2d9f77e046029d4b37ff2c4c8251', 'request_id': 'req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:43.500326 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] The token cache is being invalidate because project b92f2d9f77e046029d4b37ff2c4c8251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:47:43.500642 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:43.501252 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-cb86cc45-c403-4288-b2dd-3dd4e85cce6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:47:43.503434 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1447/2877] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:47:43 2022] DELETE /identity/v3/projects/b92f2d9f77e046029d4b37ff2c4c8251 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:47:52.947210 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:53.497412 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:11.057862 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:48:11.068513 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:48:11.212597 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadaa0bf-ee58-4fe3-87e9-d6334fb3dc53 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:48:11.283997 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:48:11.284699 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:48:11.285014 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:48:11.285315 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:48:11.287824 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:48:11.302577 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:48:11.304203 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:48:11.317450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1431/2878] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:48:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:48:13.136994 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3530e-3fd8-4a99-9b86-419a6c424bef None None] REQUEST_METHOD: `POST` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:48:13.137507 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3530e-3fd8-4a99-9b86-419a6c424bef None None] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:48:13.137623 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c3530e-3fd8-4a99-9b86-419a6c424bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:48:13.156040 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.auth.core [None req-96c3530e-3fd8-4a99-9b86-419a6c424bef None None] MFA Rules not processed for user `d3d92c0c69cf470e8aecb57e79e5a7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80334) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:48:13.157295 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-96c3530e-3fd8-4a99-9b86-419a6c424bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:48:13.212772 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1448/2879] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:48:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:48:13.525605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:48:13.527212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:48:13.566518 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=100 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:13.604967 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec001c-3053-4326-a93b-af72dbad4623 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:48:13.609011 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:48:13.609653 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:48:13.609933 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:48:13.610214 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:48:13.611956 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:48:13.622061 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:48:13.623469 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:48:13.631855 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1432/2880] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:48:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:48:16.364910 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3530e-3fd8-4a99-9b86-419a6c424bef None None] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:48:16.366953 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-96c3530e-3fd8-4a99-9b86-419a6c424bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:48:16.435830 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c3530e-3fd8-4a99-9b86-419a6c424bef None None] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:48:16.440744 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:48:16.441409 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:48:16.441674 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:48:16.441961 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:48:16.443990 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:48:16.455734 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:48:16.457360 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:48:16.467929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1449/2881] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:48:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:48:23.627738 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=19 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:26.463532 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=57 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:33.781336 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:48:33.782874 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:48:33.799227 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b508aa-0634-41db-ac78-387f7ea09cfc service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:48:33.804992 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bdca6-d42a-48c7-8734-0e5433c36e5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:48:33.805628 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bdca6-d42a-48c7-8734-0e5433c36e5f service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:48:33.805908 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bdca6-d42a-48c7-8734-0e5433c36e5f service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:48:33.806180 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bdca6-d42a-48c7-8734-0e5433c36e5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:48:33.807888 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-556bdca6-d42a-48c7-8734-0e5433c36e5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:48:33.819995 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bdca6-d42a-48c7-8734-0e5433c36e5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:48:33.821629 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bdca6-d42a-48c7-8734-0e5433c36e5f service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:48:33.832007 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1433/2882] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:48:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:48:43.827547 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:10.309199 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:50:10.310594 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:50:10.387225 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a97e86-cce9-4434-9bfa-9e96d9031743 service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:50:10.390842 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e08e18aa7d0941f9892986e737ba9e98', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:50:10.391488 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:50:10.391773 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:50:10.392049 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:50:10.393832 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:50:10.404351 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:50:10.405800 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:50:10.414998 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1450/2883] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:50:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:50:18.835201 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edaea2-7c50-455d-9c31-6ee984fd48cd None None] REQUEST_METHOD: `POST` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:50:18.835734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edaea2-7c50-455d-9c31-6ee984fd48cd None None] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:50:18.835734 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edaea2-7c50-455d-9c31-6ee984fd48cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:50:18.854603 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.auth.core [None req-40edaea2-7c50-455d-9c31-6ee984fd48cd None None] MFA Rules not processed for user `d3d92c0c69cf470e8aecb57e79e5a7fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80335) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:50:18.855781 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-40edaea2-7c50-455d-9c31-6ee984fd48cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:50:18.862936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1434/2884] 10.222.0.24 () {58 vars in 957 bytes} [Wed May 25 07:50:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 07:50:20.411098 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=35 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:20.948468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:50:20.948468 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:50:20.985915 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbca342-c0f4-45a0-9632-56bb0782ba04 service cinder] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:50:20.991083 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487193a9-ab48-4ba6-8204-4e909778ec62 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:50:20.991714 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487193a9-ab48-4ba6-8204-4e909778ec62 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:50:20.992003 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487193a9-ab48-4ba6-8204-4e909778ec62 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:50:20.992282 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487193a9-ab48-4ba6-8204-4e909778ec62 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:50:20.994096 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-487193a9-ab48-4ba6-8204-4e909778ec62 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:50:21.006925 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487193a9-ab48-4ba6-8204-4e909778ec62 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:50:21.008548 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487193a9-ab48-4ba6-8204-4e909778ec62 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:50:21.018882 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1451/2885] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:50:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:50:28.848382 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=3 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:31.014240 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=15 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:39.639485 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edaea2-7c50-455d-9c31-6ee984fd48cd None None] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:50:39.640915 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-40edaea2-7c50-455d-9c31-6ee984fd48cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:50:39.686489 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edaea2-7c50-455d-9c31-6ee984fd48cd None None] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:50:39.692964 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a06a84967694e68a3a77bf29f16ee3b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'ResellerAdmin', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:50:39.693651 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:50:39.693936 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:50:39.694212 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:50:39.696002 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:50:39.708756 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:50:39.710398 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:50:39.721225 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1435/2886] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:50:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:50:49.716606 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=18 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:08.953381 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487193a9-ab48-4ba6-8204-4e909778ec62 service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:52:08.963175 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487193a9-ab48-4ba6-8204-4e909778ec62 service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:52:08.979232 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50f0e7-d01d-40aa-80a6-680f9ed9b75f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:52:08.980278 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50f0e7-d01d-40aa-80a6-680f9ed9b75f service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:52:08.980627 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50f0e7-d01d-40aa-80a6-680f9ed9b75f service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:52:08.984019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50f0e7-d01d-40aa-80a6-680f9ed9b75f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:52:08.984019 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-8b50f0e7-d01d-40aa-80a6-680f9ed9b75f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:52:08.998824 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50f0e7-d01d-40aa-80a6-680f9ed9b75f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:52:09.000267 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50f0e7-d01d-40aa-80a6-680f9ed9b75f service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:52:09.011719 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1452/2887] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:52:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 07:52:10.196396 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:52:10.198024 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:52:10.210560 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de9542-3b7b-45df-999b-03462adfc747 service nova] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:52:10.214261 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011c209-a2b3-4eb8-8fec-a6fd75c368bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:52:10.214898 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011c209-a2b3-4eb8-8fec-a6fd75c368bc service neutron] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:52:10.215177 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011c209-a2b3-4eb8-8fec-a6fd75c368bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:52:10.215450 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011c209-a2b3-4eb8-8fec-a6fd75c368bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:52:10.218021 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-8011c209-a2b3-4eb8-8fec-a6fd75c368bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:52:10.232797 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011c209-a2b3-4eb8-8fec-a6fd75c368bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:52:10.234224 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011c209-a2b3-4eb8-8fec-a6fd75c368bc service neutron] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:52:10.247082 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1436/2888] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:52:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:52:19.006397 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=6 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:20.240460 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=6 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:21.884913 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50f0e7-d01d-40aa-80a6-680f9ed9b75f service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:52:21.893711 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50f0e7-d01d-40aa-80a6-680f9ed9b75f service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:52:21.897315 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e53eb0-ed41-424a-be6f-6596694adf6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5f94913ac8a463db617fbe30df395b1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:52:21.897942 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53eb0-ed41-424a-be6f-6596694adf6c service neutron] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:52:21.898219 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53eb0-ed41-424a-be6f-6596694adf6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:52:21.898489 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e53eb0-ed41-424a-be6f-6596694adf6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:52:21.900331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-a8e53eb0-ed41-424a-be6f-6596694adf6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:52:21.984985 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e53eb0-ed41-424a-be6f-6596694adf6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:52:21.986451 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e53eb0-ed41-424a-be6f-6596694adf6c service neutron] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:52:22.005668 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1453/2889] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:52:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:52:25.464133 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011c209-a2b3-4eb8-8fec-a6fd75c368bc service neutron] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:52:25.480929 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011c209-a2b3-4eb8-8fec-a6fd75c368bc service neutron] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:52:25.486928 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:52:25.487575 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:52:25.487860 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:52:25.488143 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:52:25.491654 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:52:25.503991 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:52:25.505605 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:52:25.516506 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1437/2890] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:52:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:52:28.745112 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e53eb0-ed41-424a-be6f-6596694adf6c service neutron] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:52:28.756746 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e53eb0-ed41-424a-be6f-6596694adf6c service neutron] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:52:28.761929 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1b71a-af87-43a5-99e0-e88a6919faf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:52:28.762578 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1b71a-af87-43a5-99e0-e88a6919faf9 service placement] REQUEST_METHOD: `GET` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:52:28.762865 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1b71a-af87-43a5-99e0-e88a6919faf9 service placement] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:52:28.763141 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1b71a-af87-43a5-99e0-e88a6919faf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:52:28.765421 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-77f1b71a-af87-43a5-99e0-e88a6919faf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:52:28.777102 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1b71a-af87-43a5-99e0-e88a6919faf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:52:28.778718 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1b71a-af87-43a5-99e0-e88a6919faf9 service placement] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:52:28.789696 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1454/2891] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:52:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:52:28.900271 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:52:28.901838 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:52:28.916723 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15eb9e-fa65-4a36-88e6-49b662250f68 service placement] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:52:28.921515 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:52:28.922381 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:52:28.922697 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:52:28.923025 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] PATH_INFO: `/v3/users/d3d92c0c69cf470e8aecb57e79e5a7fe` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:52:28.924149 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3d92c0c69cf470e8aecb57e79e5a7fe)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:52:28.926107 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:52:29.112038 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3d92c0c69cf470e8aecb57e79e5a7fe'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.119138 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3d92c0c69cf470e8aecb57e79e5a7fe'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.119858 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3d92c0c69cf470e8aecb57e79e5a7fe'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.131710 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3d92c0c69cf470e8aecb57e79e5a7fe'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.132405 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3d92c0c69cf470e8aecb57e79e5a7fe'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.229289 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1438/2892] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:52:28 2022] DELETE /identity/v3/users/d3d92c0c69cf470e8aecb57e79e5a7fe => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:52:29.483653 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1b71a-af87-43a5-99e0-e88a6919faf9 service placement] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:52:29.497128 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1b71a-af87-43a5-99e0-e88a6919faf9 service placement] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:52:29.556701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:52:29.557563 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:52:29.557873 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:52:29.558151 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] PATH_INFO: `/v3/projects/f5e67d0f06be415794efd436655904b3` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:52:29.559331 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5e67d0f06be415794efd436655904b3)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:52:29.561861 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:52:29.642129 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5e67d0f06be415794efd436655904b3', 'request_id': 'req-c9c251e1-af3e-4b98-bc17-e223c1261c0e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.648365 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5e67d0f06be415794efd436655904b3', 'request_id': 'req-c9c251e1-af3e-4b98-bc17-e223c1261c0e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.649584 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:29.654686 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5e67d0f06be415794efd436655904b3', 'request_id': 'req-c9c251e1-af3e-4b98-bc17-e223c1261c0e'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.743152 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] The token cache is being invalidate because project f5e67d0f06be415794efd436655904b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:52:29.743358 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.744020 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:29.745672 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1455/2893] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:52:29 2022] DELETE /identity/v3/projects/f5e67d0f06be415794efd436655904b3 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:52:29.750622 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:52:29.752009 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:52:29.765220 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb1e45-36ee-4026-98c3-4134829c5156 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:52:29.821493 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:52:29.822358 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:52:29.822644 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:52:29.822925 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] PATH_INFO: `/v3/users/19f566f40ef94e64a5c19a7a93dae2cb` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:52:29.824123 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19f566f40ef94e64a5c19a7a93dae2cb)` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:52:29.826048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:52:30.038787 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19f566f40ef94e64a5c19a7a93dae2cb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.046251 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19f566f40ef94e64a5c19a7a93dae2cb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.046914 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19f566f40ef94e64a5c19a7a93dae2cb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.051248 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:30.058934 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19f566f40ef94e64a5c19a7a93dae2cb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.063048 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.notifications [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19f566f40ef94e64a5c19a7a93dae2cb'} {{(pid=80335) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.144430 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1439/2894] 10.222.0.24 () {58 vars in 1223 bytes} [Wed May 25 07:52:29 2022] DELETE /identity/v3/users/19f566f40ef94e64a5c19a7a93dae2cb => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:52:30.403254 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] Authenticating user token {{(pid=80334) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:52:30.405701 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.fernet_utils [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80334) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:52:30.418826 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c251e1-af3e-4b98-bc17-e223c1261c0e admin admin] Validating token access rules against request {{(pid=80334) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:52:30.476823 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91002622404a49918bac736d37052f04', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c4db8d1f990d4445ab6059278607233e', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80334) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:52:30.477680 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:52:30.477958 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:52:30.478229 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] PATH_INFO: `/v3/projects/3240aa60382e493c9171f7011771816c` {{(pid=80334) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:52:30.479395 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3240aa60382e493c9171f7011771816c)` {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:52:30.481433 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] RBAC: Authorization granted {{(pid=80334) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:52:30.597641 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3240aa60382e493c9171f7011771816c', 'request_id': 'req-f86aa36d-7172-47d4-be02-c41779c8aafb'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.603955 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3240aa60382e493c9171f7011771816c', 'request_id': 'req-f86aa36d-7172-47d4-be02-c41779c8aafb'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.609690 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3240aa60382e493c9171f7011771816c', 'request_id': 'req-f86aa36d-7172-47d4-be02-c41779c8aafb'} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.681452 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] The token cache is being invalidate because project 3240aa60382e493c9171f7011771816c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80334) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 07:52:30.681689 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.682317 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG keystone.notifications [None req-f86aa36d-7172-47d4-be02-c41779c8aafb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80334) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 07:52:30.683841 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: [pid: 80334|app: 0|req: 1456/2895] 10.222.0.24 () {58 vars in 1232 bytes} [Wed May 25 07:52:30 2022] DELETE /identity/v3/projects/3240aa60382e493c9171f7011771816c => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:52:40.213441 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:40.678046 dv-cinder-825492-15-iscsi devstack@keystone.service[80334]: DEBUG dbcounter [-] [80334] Writing DB stats keystone:DELETE=10,keystone:SELECT=55,keystone:INSERT=2 {{(pid=80334) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:45.375504 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] Authenticating user token {{(pid=80335) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.377019 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:45.446877 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323462e-e6ad-4cbd-a165-cabdf4cdf4e5 admin admin] Validating token access rules against request {{(pid=80335) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.504137 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b05e0-e699-43ad-98b5-69f27fc7397b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '762b38d08d2447bfbc968245a5b2915f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '25a3ada0467e494b92c3480826a53ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80335) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.504822 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b05e0-e699-43ad-98b5-69f27fc7397b service placement] REQUEST_METHOD: `GET` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.505110 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b05e0-e699-43ad-98b5-69f27fc7397b service placement] SCRIPT_NAME: `/identity` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.505388 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b05e0-e699-43ad-98b5-69f27fc7397b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80335) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.507170 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.fernet_utils [None req-504b05e0-e699-43ad-98b5-69f27fc7397b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80335) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:45.518988 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b05e0-e699-43ad-98b5-69f27fc7397b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.520599 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b05e0-e699-43ad-98b5-69f27fc7397b service placement] RBAC: Authorization granted {{(pid=80335) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.530532 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: [pid: 80335|app: 0|req: 1440/2896] 10.222.0.24 () {60 vars in 1365 bytes} [Wed May 25 07:55:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 07:55:55.526279 dv-cinder-825492-15-iscsi devstack@keystone.service[80335]: DEBUG dbcounter [-] [80335] Writing DB stats keystone:SELECT=58 {{(pid=80335) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}